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The following elementally treatment of the Method of Least 
Squares has grown out of my attempts to so present the sub- 
ject to students of physics, astronomy, and engineering, that 
a working knowledge based upon an appreciation of its prin- 
ciples might be acquired with a moderate expenditure of time 
and labor. 

Conceiving that the ultimate warrant for the legitimacy of 
the method itself is to be found in the agreement between the 
observed distribution of residuals and the distribution repre- 
sented by the error curve, I have not scrupled to abandon 
altogether the analytical demonstrations of the equation of 
this curve and to present it as an empirical formula, represent- 
ing the generalized experience of observers. The evidence in 
support of a formula of this kind is necessarily cumulative, 
and the few curves which are presented in illustration of the 
law of error are to be considered as samples of the kind of 
evidence which exists in great abundance By abandoning 
the theoretical demonstrations, the student is freed from the 
embarrassments which are usuallj encountered at the thresh 
old of the subject, and which in m^my cases c^use it to appear 
as a mathematical puzzle whose analjticil difficulties absorb 
the attention of the tyro to the complete exclusion of the pur 
poses for which the analysis is conducted 

I have sought to give prominence to the distinction between 
accidental and systematic errors and to insist upon the limi 
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tations which result fi-oni the difference between these two 
classes of error. To illustrate the principles of the text, I 
have made free use of numerical data and have arranged the 
computations in forms which experience has shown to he 
convenient for the purpose, with a view to their aul)sec[uent 
use by the student as models for bis own computations. 

In the preparation of these pages, I have consulted many, 
if not most, of the standard treatises upon the subject, but 
my indebtedness for suggestions and methods of treatment 
is principally to 

Faye, Cours d'Astronomie de I'Ecole Poly technique. 

Oppolzer, Lehrbuck der BiOmbe^timnuing. 

Weight, Treatise oh the Adjustment of Observations. 

G. C. C. 
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THE METHOD OF LEAST SQUAKES. 



§ 1, Problem. To determine the coefficient of linear expan- 
sion of a certain bar of metal its length was determined at 
different temperatiires by comparison with a standard of known 
length. The data furnished by the measures are (Koldrausch, 
■len der Phyxik) .- 



20^ C. 1000.92 

40 1000. G5 

50 1000.90 

tiO 1001.05 

It is reqi'ired to determine from these observations the amount 
of the expansion of the bar per degree Centigrade. 

If c denote the required expansion, and If, the length of the 
bar when its temperature is 0° C, its length, I, at any other 
temperature, (, may be represented by the equation 

By means of this equation the four observations recorded 
above are transformed into the following obKCi-vatlon equations : 

(1) /,> + 20 c = 1000.22"^ 

(2) ?„ + 40f= 1000.65 ' 

(3) S,-|-50(,- = 1000.iH) 

(4) ?„ + 00c = 1001.05 

Any two of these equations are sufficient to iletermine the 
values of Jj and c, but tbe values derived from different pairs 
of equations will be tUfierent. Thus we may find from 
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2 THE METHOD OF LEAST SQUAllliS. 

Eqaations. ti, c 

(1) and (2) 999.7y +*0.0215 

(1) and (1) 999.80 .0208 

(2) and (3) 999.65 .0250 

(3) and (4) 1000.15 .0150 

We are here presented with ii problem of constant recur- 
rence in the investigations and applications of physical science. 
In order to determine the values of certain quantities ^vith a 
high degree of precision more measures or observations ai'e 
made than are absolutely necessary, and these observations 
prove to be inconsistent among themselves, so that the result- 
ing values of the unknown quantities depend upon the manner 
in which the data are combined. It is evident that all of the 
values above found for l„ and c cannot be correct, and it is 
doubtful if any absolutely correct value can be derived from 
the data ; but it is also apparent that the observations are not 
worthless and tliat any of the values above derived may be 
considered as approximations, more or less close, to the true 
values of the required quantities. 

If we assume that the relation between the length of a bar 
and its temperature can be expressed by an equation of the 
form employed above, we must suppose that the discordances 
in the results are due to errors in the observations, and the 
problem then becomes : 

To find from the observed data a set of results which shall 
be affected as little as possible by the errors of the data, or in 
more technical language, to find the most probable values of 
the unknown quantities. 

We may establish in advance of any forma! investigation of 
this problem certain principles to which its solution must eon- 
form. Thus, 

(A) The adopted values of the quantities which are to be 
determined must be based upon aU the data available. Only 
in exceptional cases, which will be considered hereafter, is it 
proper to omit or reject any observation or any known rela- 
tion among the quantities. 
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ERKOllS AND ItESIDUALS. O 

{}{) The adopted values must satisfy tlie observation equa- 
tions as nearly as possible. 

§ 2. ErrorB and Residuals. The expression error of an 
observation has been freely used in the preceding section, hut 
it should he recognized that the amount of this error can 
rarely, if ever, be known, since this would imply an exact 
knowledge of the unknown quantities. We may, however, 
obtain approximate values of these errors from the adopted 
values of the quantities which were to be determined. Thus, 
if the values 1,, = 999.79, c= +0.0215 be substituted in equa- 
tions (1), these become 

(1) 1000.22 = 1000.22 (3) 1000.87 = 1000.90 

(2) 1000.65=1000.65 (4) 1001.08 = 1001.05 

The difference between the first and second members of any 
one of these equations is called the resiriual of that equation, 
and is approximately the error of the corresponding observa- 
tion. The residuals which corresirond to the several values of 
la and c derived in § 1 are given below in tabular form. 

;„ = 9951.79 999.80 9!)9,(i5 1000.15 

c =+0.0215 -i-0.0208 -H0.0250 -H 0.0150 



-t- .0;5 .00 - .10 .00 

We may thus, for any assumed values of the unknown quan- 
tities, find a corresponding set of residuals, and the smaller 
these residuals are the closer is the probable approximation of 
the assumed, to the trae values. Principle (B). 

This statement, however, requires an important qualification 
to which we now proceed. 

The eiTors with which any given series of observations is 
affected may be divided into two classes : 

Accidental Errors, or those whose law of recurrence ia such 
that in the long run they are as often positive as negative and 
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4 THE METHOD OF LEAST SQUARES. 

whose effect upon the mean of a great number of observations 
therefore differs but little from zero ; and 

Systematic Ermrs, or those which in the given series of 
observations do not thus tend to be eliminated from the mean. 
In the observations considered in § 1, an error of judgment by 
which the observer in a given case read the thermometer OM 
too high would probably be an accidental error, since it may 
be presumed that in the long run he would read it as often too 
low as too high, but if through a iixed habit of observing, the 
thermometer were always read too high this would be a sys- 
tematic error, and the number of observations might be indefi- 
nitely increased without in the least diminishing its effect. 

If the standard of length with which the bar was compared 
were an erroneous standard {e.g. 0,01 mm. too long), all of the 
observations would be affected with a systematic error due to 
this source, and the residuals would furnish no trace of this 
error, since they show only discordances among the observa- 
tions, and not errors affecting all alike. The smallness of the 
residuals in any case, therefore, furnishes no guaranty that the 
observations and the results derived from them have not been 
vitiated by systematic errors. 

The presence of errors of this class constitutes the greatest 
obstacle to the accurate determination of any set of quantities 
whose values are sought, and the ingenuity and skill of the 
observer or experimenter cannot be better employed than in 
avoiding or overcoming the effect of such errors. It therefore 
deserves especial notice that systematic errors can often be 
transformed into accidental errors by varying the methods of 
observation or the conditions under which the observations are 
made. Thus the possible systematic error of judgment in 
reading a thermometer, to which allusion was made above, may 
be transformed into an accidental error if several different per- 
sons take part in the observations, since it is hardly probable 
that they will all have a common, persistent error of judgment. 
The error due to using an erroneous standard of length may 
be changed into accidental error by employing a number of 
different standards, since it is not probable that these, con- 
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THE DISTRIBUTION OP RESIDUALS. 5 

structed at different times ami by different makers, will all 
have a common error of length. Considerations of this char- 
acter serve to illustrate the great practical importauce of vary- 
ing the methods of determining any quantity whose valuf, is 
desired with great precision. Multiplying observations by the 
same method and under similar circumstances serves only to 
diminish the effect of accidental errors and is useless beyond a 
certain limit, while varying the methods and the circumstances 
under which observations are made tends to eliminate errors 
of both kinds. 

The principles here considered find their appropriate appli- 
cation in the selection of the methods by which any given set 
of unknown quantities is to be determined, but after the obser- 
vations have been made, since they can, in general, furnish but 
little, if any, information in regard to their own systematic 
errors, these must be neglected and the reduction and discus- 
sion of the observations directed toward eliminating the effect 
of the accidental errors. 

§ 3. The Distrlbatioa of Residuals. Gauss, a German mathe- 
matician, has shown by a course of analysis based upon the 
theory of probabilities that in any given series comprising a 
very large number of observations affected with accidental 
errors, the number of errors of a given magnitude, x, is a func- 
tion of that magnitude. Thus, if x' and x" denote any two 
errors, and y' and y" the number of observations having the 
errors x' and x" respectively, then 

The analytical expression ioTf(x) obtained by Gauss is 

/(*) = -^e-'i=^, (2) 

where e = base of the Naperian system of logarithms, 

JT = ratio of the circumference to the diameter of a circle, 
A = a number whose value must be derived for each series 
of observations, but is constant for all the obser- 
vations of that series. 
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6 THE METHOD OF LEAST SQUARES. 

The same expression for f{x) has been derived by other 
mathematicians through different courses of analysis, but 
against all of these investigations objections of a theoretical 
character have been urged. Experience, however, shows that 
the actual distribution of residuals does follow this law, not 
with absolute accuracy, but to a remarkable degree of approxi- 
mation. An excellent illustration of this distribution in the 
case of a comparatively sniall number of observations is 
afforded by a series of 66 determinations of the velocity of 
light made at Washington, in the year 1882.* By means of a 
revolving mirror the time required for the passage of a ray of 
sunlight from one terrestrial point to another was measured. 
The mean of the 66 determinations of this tune interval was 
24.827 millionths of a second. By subtracting this mean from 
each single determination a series of residuals will be obtained, 
and the number of residuals whose magnitude equals 1, 2, 3, 
etc. units may then be counted. In this way a fair approxi- 
mation to the distribution of residuals represented by Gauss's 
law of error will be found; but as this law purports to repre- 
sent the average distribiition of a great number of errors, we 
shall obtain a better comparison between it and the actual dis- 
tribution by the following device, to which we resort in order 
to increase the number of available residuals : 

Let it be assumed that in any given set of observations the 
number of residiials of magnitude x is proportional to the num- 
ber of residuals occurring between the limits x~a and x + a, 
where ct is a quantity which in strictness ought to be an infini- 
tesimal, but which may be made a small finite quantity without 
appreciable error. In the present case we adopt as the unit in 
which the residuals are to be expressed, the thousand-millionth 
part of a second (O'.OOOOOOOOl), and put a equal to two such 
units. Thus, from a series of 66 observations are derived the 
following numbers which represent the distribution of resid- 
uals which might be expected to occur in a much longer series. 

• Velocity of Light in Air and Refracting Media. Bureau of Navi- 
gation, Navy Department, 1885, p. 187. 
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THE DISTRIBUTION OF RESIDUALS. 
Beeidual. So. % Kesidual. No. 

Less than — 13.6 o 2 0.8 o-t Greater than + 13.5 - 



- y.6 . 18 7.0 ■ /.■ + 2.5 IT (i.G 

- 1.5 21 8.2 - ' + I.S 21 8.2 

- 0,5 • 23 8.9 -'." + 0.5 23 8.9 

The colmnii headed ^ represents the number of residuals 
differing not more than half a unit from the magnitude given 
in the fir&t column, expressed as a percentage of the whole 
number of residuals. Kg. A furnishes a graphical i-epresenta- 
tion of this distribution, each percentage in the above table 
being represented by a point whose abscissa is the magnitude 
of the residual and whose ordinate is the percentage itself. 
The curve whose equation is 

!, = l»^«-»w 4 = 0.158 

Vt 
is shown in the same figure, and a simple inspection of the 
curve shows that its ordinates represent very approximately 
the percentage of residuals of each magnitude. The coeffi- 
cient h appears multiplied by the factor 100 in order that the 
ordinates may be represented as percentages. 

Figs. B, C, D, represent the distribution of residuals in three 
other series of observations of different kinds, made at differ- 
ent places, by different observers, but all following the same 
law. The unit in which the residuals are expressed, unit of x, 
is stated with each figure, and the unit of y is in every case 
one per cent of the whole number of residuals. 

The equations of the several curves shown in the figures are 
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almost identical, but the feature to which the student's atten- 
tion is called is that the algebraic form of the equation is in 
each case 

-'And not that A has approximately the same value in each 
curve. The numerical value of k depends upon the unit 
adopted for x, and these units having been chosen with refer- 
ence to a convenient graphical representation of the residuals, 
the agreement in the several values of h must be, regarded as 
purely artificial. 

The series of observations represented in Fig. D is known 
to be affected with small systematic errors, and it will be 
noted that the distribution of the residuals is more irregular 
in this case than in any of the others. In each of the series 
represented in Figs. A and C, there are two residuals whose 
magnitudes are too great to be represented in the figures ; and 
it is quite generally found that the actual number of very large 
residuals is slightly greater than the number given by the 
error curve. The dluatrations here given are typical cases, 
and may serve to exemplify the statement made at the begin- 
ning of this section, that the actual distribution of residuals is 
found to follow G-auss's law of error, and in the following sec- 
tions this law will be assumed as experimentally demonstrated, 
and from it will be derived the method of combining and dis- 
cussing observations. The student will find it an instructive 
exercise to treat in a manner similar to that pursued above 
any series of observations to which he may have access, par- 
ticularly his own observations, and thus lend additional weight 
to the experimental evidence which is here presented for liis 
consideration. 

§ 4. The Brror Curve. From the manner in which the ordi- 
nates of the points plotted in Figs. A, B, C, and D were derived, 
it will be apparent that these ordinates represent the number 
of residuals falling within certain chosen limits of error. Thus 
in Fig. A, 8.9 per cent of all the residuals lie between the 
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limits and +1, 8.2 per cent between +1 and +2, etc., the 
interval within which the residuals are enumerated being in 
every ease one unit. It is also evident that the number of 
residuals falling within any other interval, Ax, will depend 
upon the magnitude of this interval as well as upon the ordi- 
nate corresponding to it, and if A a; is takeu sufficiently small 
the number of residuals will be proportional to the product 
y-Ax. Greometrically considered, this product is the area in- 
eluded between the axis of x, the curve, and the two ordinates 
drawn through the extremities of Ak, and the number of resid- 
uals falling within the limits of Aa is therefore proportioual 
to this area. We may, if we choose, make A a; an infinitesimal, 
and the area y- Aa; and the corresponding number of residuals 
will then become indefinitely small, but by talcing the sum of 
all the infinitesimal areas included between the limits a; = <t 
and x = b, where a and h have any values whatever, we obtain 
the area of that part of the curve included between ordinates 
drawn at these limits. By a similar process of summation we 
obtain, the number of residuals lying between a and 6, and the 
number of residuals thus found must be proportional to tlie 
area, since this proportionality is true in every infinitesimal 
element included in tlie area. 

In the following table, the function, A, represents the area 
of that part of the error curve included between ordinates 
whose abscissas are and x, the argument of the table being 
the values of x for the particular error curve in whose equa- 
tion A = 1 ; but the area included between and x in the curve 
corresponding to any other value of h may be found from the 
same table, by using as the argument hx instead of x. 

The area of that part of the curve lying between the limits 
a and b is represented by 

A = Cytix = — - Ce-'^^'dx {.'5) 

Let the variable in this expression be changed by putting 
hx = t, and the expression becomes 

A = ~ Cl-''dt 

Hosted byGoOglc 
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These expressions for A become identical if 7t = 1 ; lience, if 
the value of A be computed from the second ititegi-al for A = 1 
and tabulated, we may find from this table the value of A cor- 
responding to any other value of h by changing the limits a, 
b into ha and hb. 

A remarkable property of the curve, which will be of use 
hereafter, may be reatlily obtained from the expression lieM 
found for A If we make a = and 6 = oo, the limits of the 
integral become and x for all values of li, hence the area of 
that part of the cui-ve included between a; = and x = oo is 
the same for all values of h, i.e., for every series of observations. 



Tahi,e 



■ Abka.s of the Ebrou CriiVK 
Limits axd hx. 



0,0 


.1 i>irt. 


,.. \ ,. „,„. 


.. 


0,4!)7Ca 


.iff. 


0.000 




1,0 0,+2l 


2,0 


0,1 

0.2 

0,J 


.OJG 
.111 

,i(;4 


i,!. 


1.1 .440 

li-; 

1.2 ■ ,45,-. 

' 12 

i,:i 1 Mr, 


2,1 
2.2 


,4i)851 
.49y07 

,4yii4:i 


.'.(I 


0,4 


.214 


4(! 


1,4 


,471} 


2.-1 


.499C0 


14 


0,5 


.200 


+2 


1,5 


.48:i 


2.5 


.49980 


it 


o.e 

0,M 


.ao2 


:i7 
;!2 


l.G 
1,8 


.488 

4 
.492 

1 


2.G 

2.8 


.4U989 
,40993 
.49996 


4 
3 
2 


0.1) 
1,0 


.308 
.421 


■iZ 


1.9 
2.0 


.4!»e 

,-!!18 


2,11 

:i.o 


.4i)!(98 
.49990 
.50000 


^' 



If in any series of observations w] denote the number of 
residuals whose magnitudes are included between the limits « 
and h, n the whole number of residuals in the series, and j4„. 
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jlj tlie vahifis uf A ubtaiiied from the tiiljle with the arguiiieuts 
lin, hb, tlien 

since the ratio of n'\ to n is equal to the ratio of the area of 
that pai't of tlie error curve whiuh lies betweeu the limits a 
and b, to the area of the whole curve, and this latter area is 
seen from the table to be always unity. The — sign in this 
equation is to be used when a and b have like signs, and the -f- 
when they have unlike signs. If the percentage of residuals 
betweeu the limits a and & is i-equired, it may be found by 
substituting 100 in place of n as the coefficient of {Ai':^A^. 

Thus from Fig, A we find for the series of obsei-vations there 
represented, W = 0.025 and h = 0.1*i8. 

To find the distribution of residuals between the limits 

_Qo '>, -r, 2, -^'... + 1, +1...+4, +A--+X, 

we proceed u.s follows : 



u..-,uo 



-0.790 
-O.SIU 



The uumbei-s in the column "I'cr cent" aiiay be comjiared 
with the pei-centages given on page 7. The column 'H)b8." 
gives the actual number of i-esiduals wliich occur in the given 
series between the limits here considered, and these numbers 
shoidd be compai-ed with the column ""],-" 

By the use of this table, the distribution of residuals in any 
series of observations for which the value of A is known may 
be compared with the theoretical distribution much more 
readily than by plotting a curve, and the student should in 
this way examine several series of observations. The method 
of determining h for any given series is contained in § 12. 
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§ 5. The f rinciple of Least Squares. The quantity ft which 
appears in the equation of the eri'or curve deserves especial 
attention. If in the equation 



X be put equal to zero, the resulting value of y is — ;. This is 

the maximum ordinate of the curve, and the value of this 
maximum ordinate varies directly as h. If those parts of the 
curve remote from the axis of y be considered, it will be found 
that the larger is A, the smaller are the values of y, siuce when 
a; is a large quantity e"^*" diminishes much more rapidly for 
increasing values of h than li itself increases. These relations 
between y and h correspond exactly to the criteria by which 
we estimate the precision of observations. If we compare two 
series of observations, I. and II., and find that in series I. the 
Binall errors are relatively more numerous (large values of y 
for small 3^s), and the large errors less numerous (small values 
of y for large a;'s), than in series II., we shall without hesita- 
tion call the observations of series I. more precise or accurate 
than those of series II. ; and if required to assign definite 
meanings to the terms "more precise" and "less precise," we 
shall find difficulty in defining them in any other manner than 
by reference to the magnitude of the residuals. We therefore 
adopt as the measure of precision of any series of observations 
the value of 7i in the equation of its error curve ; and having 
thus defined the term " precision," we are able to state two 
principles which are of general application in the discussion 
of observations. 

Let the data furnished by each observation be expressed in 
the form of an observation equation (Equations 1, § 1), then : 
the best attainable values of the unknown quantities are those 
which, 

(1) Distribute the residuals in accordance with the law of 
error, y = — ^ e"***^, and which, 
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(2) Make the value of Ji in the equation of the resulting 
error curve a maximum. 

The first of these principles is indeed involved in the sec- 
ond, since if the residuals are not distributed in accordance 
with the law 

there can be no value of h to be made a maximum. It is, how- 
ever, advantageous to state (1) as a separate principle, since it 
affords a teat of the presence of systematic errors in the data, 
which, though far from being a perfect criterion, is often con- 
venient and is sometimes the only test available. 

To justify the statement of (2), we resort to the following 
considerations : In accordance with A, § 1, we suppose that all 
of the data available is contained in the observation equations, 
and, B, §. 1, we seek to satisfy all of these eq^uations as nearly 
as possible, If tlie observations are free from systematic 
en-or, a supposition which must here be maile, since we have 
no means of taking into account the effect of such errors, we 
may obtain by substituting in the observation equations any 
set of values which approximately satisfy them, a correspond- 
ing set of residuals which will be the errors of the observations, 
on the siipposition that the substituted values were the true 
values of the unknown quantities. If these residuals are plot- 
ted in an error curve, they will furnish a numerical measure 
of the precision h, assigned to the observations by this set o£ 
values, and out of all possible sets of values of the unknown 
quantities that set which Eissigns the maximum precision to 
the observations will be entitled to the greatest degree of con- 
fidence ; for if it were otherwise, we should have no reason for 
preferring a set of values which exactly satisfied all of the 
equations to a set which did not satisfy them. 

It is, of course, true that subsequent observations may fur- 
nish a better determination of the unknowns, and that the 
values thus found will not assign to the earlier observations as 
high a degree of precision as did the erroneous values obtained 
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from these observations aloae, but this subsequent determinar 
tion is based upon additional evidence, and the problem, with 
which we are concerned is not to obtain the best possible val- 
ues of the unknown quantities, but the best values which can 
be derived from the data in our possession. 

Assuming, then, the validity of (2), we proceed to transform 
it into an. expression more convenient for praetical use, and for 
this purpose we resort to the following property of the error 
curve, which may be approximately verified by actual measure- 
ment from any plotted curves. Figs. A, B, C, D. 

If the error curve be divided into a great number of parts 
by drawing equidistant ordinates throughout its whole extent, 
and the areas of the several parts into which the curve is thus 
divided be each multiplied by the square of the abscissa of its 
middle point, the sum of all these products will equal — -. 

The analytical expression for the process above described is 
C'^ijdx or ~ r^e-^'^'rfa; 

Put kx = t, and this integral becomes 

For the method of obtaining the value of the last integral, 
see NewmmVs Calculus, Articles 169, 176. 

The area of each of the parts into which the curve was 
divided is proportional to the number of residuals occuning 
between the limiting ordinates of the part ; thus, let A denote 
the area of the part, N the corresponding number of residuals, 
and n and a the whole number of residuals and the whole area 
of the curve respectively ; then 

^:JV::a:w 

but from the table in § 4, a = 1, whence 
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Since JV denotes the number of afs falling within the given 
infinitesimal part, A, of the curve, Ifx' is eqiial to the sum 
of the squares of the ib'b (residuals) whose magnitudes fall 
between the limiting ordinates of A, and taking the sum of all 
the Ax"s we obtain , 

^Ax'^^S,)-" 

i.e., is equal to the mean of the squares of all the residuals. 
It is customaiy to represent the sum of the squares of the 
residuals by the symbol [vt'], v standing for any residua!, and 
the [ ] denoting the sum of all quantities of the kind written 
within them. 

Comparing this result with the one obtained above, we have 

1M=A (4) 

from which it appears that the relation between h and the 
sum of the squares of the residuals is such that when h is 
a maximum, [I'l'J is a minimum, and principle (2) may be 
restated as follows : 

2'he most probable values of the miknoicn quantities are those 
ivhicJi make the sum of the squares of the residuals a minimum. 

From this principle has been derived the name Method of 
Jjeast Squares, which is commonly applied to that body of 
principles which treats of the combination and discussion 
of observed data. 

We have arrived at this principle from a consideration of 
that class of cases in which the quantity observed is a func- 
tion of two or more unknown quantities whose values are to 
be obtained from the observations. This obviously includes 
the case of a single quautity, x, whose value is directly meas- 
ured ; and it will be advantageous to apply the principle of 
least squares to this case. The observation equations are here 
of the simplest possible form. 



where m denotes an observed value of x. 
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If x„ denote any assumed value of x, the residuals obtained 
by substituting it in these equations will be 



and lw^ = (^,n,-^„r + {m,-^„y + {nH-,:,r.: + ivK-x,y. 
The value of x^ which will make [uv] a luiiiimuiu is found 
from 

« =0= -2(,..-..) -■.(»..-..) -2(„..-.r.)... -2(,,,,->,) 

but this equation is equivalent to 

^^ m| + m, + >'^ + -+m,. _[M] 

and it thus appears that tlie universal practice of taking the 
arithmeticEil mean of all the measures of a single quantity as 
the best value of that quantitj', is a, particular case under the 
more general method of least scpiarea. 

§ 6. Weights. It frequently happens that the circumstances 
under which an observation was made lead the observer to dis- 
trust its accuracy, while other causes give him increased confi- 
dence in another observation. Observations which thus differ 
in quality are said to have diiferent weights, the weight being 
a numerical measure of the quality, and these weights should 
be taken into account in combining the observations. 

Let us suppose two series of observations made upon the 
same unknown quantity, in one of which the observations are 
of different quality and entitled to different degrees of confi- 
dence, while in the other the observations are all equally good, 
but each of them entitled to less confidence than the poorest 
observation of the first series. By taking the mean of a num- 
ber of observations of this second series, a more reliable value 
of the unknown quantity may be obtained than any single 
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observation of the aeries can furnish, and by properly choosing- 
the number of observations to be included in the mean, a value 
entitled to as much confidence as any observation of the first 
series may be found. This number of observations of the sec- 
ond series whose mean is entitled to as much confidence as a 
single observation of the first series, is called the weiglit of the 
equivalent observation in the first series ; and, obviously, the 
better an observation, the greater is its weight. Tlicse weights 
furnish no information about the absolute precision of the 
observations, but express only their relative excellence as com- 
pared with each other ; hence, if jj„ p^ p^ etc., be the weights 
of any observations, kp,, kp.^, kp^, etc., where k is any constant, 
will express these weights equally well, since it is the ratios 
of the weights, and not their absolute values, which are of 
importance. 

To exhibit tlie maimer in which these weights are to be 
employed, let us recur to the (hita of S 1, and suppose that 
those observations were made under such conditions that the 
first one has a weight 1, the second 2, the third 3, and the 
fourth 4. In accordance with the definition of weights, this is 
equivalent to supposing a second series of observations of uni- 
form excellence, such that the first of the actual observations 
can be replaced by one observation of this series, which must 
of course be nuinerically the same as the observation which it 
replaces ; the second real observation may be replaced by two 
numerically equal observations of the second series ; the third 
by three, etc. Each of these substituted observations will fur- 
nish an equation precisely like those given in § 1, and when 
the sum of the squares of the residuals is formed, we shall ' 
obtain 

The symbol [jpw], which is adopted as an abbreviation for 
this expression, is equivalent, numerically, to the sum obtained 
by multiplying the square of each actual residual by the weight 
of the corresponding observation and adding the products, and 
it is evident that this [pw} bears the same relation to th& 
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substituted observations that [uii] bore to the actual observa- 
tions in the ease of equal weights, which was considered in the 
preceding section. The principle there obtained may there- 
fore be generalized as follows : 

37(6 most probable values of the nriknown quantities are those 
K?t,ic/i make tlie sum of the weighted squares of the residuals, 

Let the student show, as in the preceding section, that when 
tliis principle is applied to the case of observations of unequal 
weight made upon a single unknown quantity, it gives as the 
most probable value of that quantity 

" M 
As an example of the application of weights, we select the 
following observations of the time of ending of the transit of 
Mercury of May 6, 1878, which were observed by different 
observers in the city of Washington, These observers wei'e 
provided with telescopes of different sizes and magnifying 
powers, and differed among themselves in point of experience 
and skill, so that their observed times of last contact are not 
entitled to equal confidence. The weights assigned to the sev- 
eral observations represent the judgment of the computer with 
respect to their relative excellence. (Washington Observa- 
tions, 187C, Appendix II., page 55.) 



37 65 

38 10 



38 ID 
38 31 



[J>»] = 


= 318 


[p] ■ 


-- 16 


[J>] " 


= 19.9 



II of tile observations = h^ 33™ 19',9. 
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S 7. Normal Equations. "We liave now to show how the 
principle of least sq^uarea is to be applied in lietermiuing the 
values of a set of unknown c[uantities, and in order to fix 
the ideas as definitely as possible, let it be supposed that there 
are three o£ these quantities, x, y, z, which ai^e connected with 
each one of a set of observed quantities, n, by the relation 

where a, 6, and c are nuniefieal coefficients whose values are 
supposed known in eatth equation. 

From a series of more than three observed values of ji, the 
most pi-obable values of x, y, z are to be obtained by means of 
the relation [pvv\ = a minimum. 

It is not to be pi-esiuned that these values when found will 
eitactly satisfy all the equations, and make [j>mi] = 0, but we 
shall find from each equation a residual v, so that strictly the 
observation equations sliouhl be written 

aiX + b^y + c^z — w, = r^ )\ 
a^ + hy + e-j: — w^ = r, ih 

n^ + b-^ + Ca« - ";l = ■'■;, }h 

etc. etc. etc. 
The symbols p^. p^ ft represent the weights assigned to the 
observed values, n,, Vj, jij, etc. 

By the ordinary rule for determining a minimum of a fiuic- 
tion of several variables, the condition [jiui'] = a minimuiu, 
furnishes the three equations 

dx ihj dz 

and in order to obtain these (leri\-ati\-es i\'e form from the 
observation equations 

-\-\aWlhx + lii-Vit..y + CoVfts - Vajii}' i ,,5, 

+ laiVpsX + b3Vihy + iW2h^ — Vp3f>3V . 
etc. etc. etc. J 
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The derivative of this expression with respect to x is 

etc. etc. etc. =0 J 

Let this expression be expanded, divided by 2 and simplified 
by the iDtroduction of [ ] to denote the snm of all terms like 
those placed within them (all terms standing in the same verti- 
cal column), and it becomes the fixst of the following group of 

Normal Equatioss, 
[^pad^x + lpab'jy + [_pac]z— [pan'] = 
[^Q*] X + IpbbJ y + [i'if;] 3 - Ipbn-] = 
\_pac] X + \_ph<i] y + \_pcc'\ z — \_pcii] = 

The second and third of these equations are derived in pre- 
cisely the same manner as the first from the conditions 

d\_pvv'\ _ f. ^P*w] _ (I 
dy dx 

These equations are equal in number to the unknown quanti- 
ties, and their solution will in general furnish a determinate 
set of values for these quantities which will be the most prob- 
able values, since the normal equations include all of the data 
furnished by the observations and have been so derived as to 
satisfy the principle of least squares. 

Equations (6) furnish a rule which is frequently given for 
the formation of normal equations. To obtain the first normal 
equation, multiply eaeh observation equation by the product of 
its weight into ■the coefficient of x which occurs in it, and take 
the sum of all the resulting equations. The other normals are 
similarly obtained frojn the weights and the coefficients of y, 
z, etc., having due regard to the algebraic signs of the quanti- 
ties in the several multiplications and divisions. This method 
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<{ convenient, but in general the method of form- 
ing normal ecLuations given in § 9 will be found less laborious. 

The symmetrical manner in which the coefficienta of the 
normal equatiojis are disposed should be especially noted, since 
this considerably diminishes the labor of their formation. The 
tirst coefficient in the second equation is the same as the second 
coefficient in the. first equation, and generally the m'" coefficient 
in the «"■ equation is the same as the k* coefficient in the in"' 
equation. 

Let the student form normal equations from the observation 
equations contained in § 1, assuming that those equations have 
equal weights. 

§8. Non-Linear Observation Ecinations. In all of the pre- 
ceding investigation, it has been tacitly assumed tliat the 
relation of the observed to the unknown quantities can be 
expressed by an equation of the first degree ; but cases in 
which this relation is of a much more complicated character 
are not uncommon, and a method of applying the principle of 
least squares to these cases is required. For the sake of sim- 
plicity, this method will be derived for the case of two un- 
known quantities, but the process is perfectly general and can 
readily be extended to any other number of unknowns. 

Let X and y be any two quantities which have not been 

directly measured but which are connected with an observed 

quantity, m, by the relation 

f{x,y,m) = f> 

which represents any equation whatever existing between x, y, 

and tti. Let x„ and y^ denote approximate values of x and y, 

such that , , 

x — Xe^Ax y = yo + ^y 

A x and A y being the corrections which must be added to x„ and 

yo in order to obtain the most probable values of x and y. We 

may, for the present, suppose that x„ and yo are mere guesses 

at the values of x and y, and we may test their correctness by 

substituting their numerical values in the equation 

/(.T,,,.m) = 
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which correspouiis to each observed value of m. If every such 
equatiou were exactly satisfied by tliese values we should infer 
that Xft and y^ were the most probable values oi' x and y. It 
cannot be expected that this perfect agreement will ever be 
found in practice, but from each observation erLuation a resid- 
ual, V, will be found, due partly to the errors of the observa- 
tions and partly to Aa; and Ay. 

If in the equation f{x, y, m) = we substitute for x an<l y 
x„ + Ax, y„ + Ay, and develop the expression by Taylor'x 
Fonnula, remembering that /(% y^ m) is the residual found 
by substituting numerical values of a^, y„ in the several observa- 
tion equations, we have 

f{x, + Ax,y, + Sy,m} = 0^v + ^Ax + ^Ay+... 
dx„ fhja 

If numerical values of v, --, -^ be inti-oduced into this 
e(iuation, it becomes ^ ■''' 

a-Ax-\-b-A7/+n — 
Each observation equation may thus be made to furnish a lin- 
ear equation involving A a; and Ay, and these equations may 
be treated by the method of § 7. It must, however, be remem- 
bered that in the above development by Taylor's Foniuda we 
have retained only the first t!iree terms of an infinite series, 
and if the approximate values a^ y^ are not so nearly the most 
prabable values that the squares and higher powers of A a; and 
Ay are inappreciable, the development and the solution based 
upon it are inaccurate. On this account, it is seldom advanta- 
geous to make a least square solution for the unknown quanti- 
ties until very approximate values of them have been found. 
These values will usually be obtained from the solution of a 
small number of the observation equations. 

The transformation of the observation equations by the 
introduction of corrections to assumed values of the unknowns 
is often advantageous even when the original equations are of 
the first degree, especially if the original quantities were of 
very different magnitudes. Thus, in the problem of § 1, the 
observation equations are of the form 
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in which « is a very small ijuaiitity while /„ is appi'oximately 
1000, If we put 

we liave '■'- = 1 '-^ = t v = f( lOtKI, 0, -m) = 1000 - w 
dli, ih: 

am! the equations are ti'aiisionued into 

ii, + 20ic-0.22 = 

A?„ + 40Ac — 0.65 = 

A;i, + yOAc-0.yi)=0 

a;u + goac-i.o5 = o 

By this transforniatioii the numevieal operations involved ia 
forming and solving the normal equations ai'e much sinijJified 
throngh the substitution of small nuinliers in the plauv of 
large ones. 

§ 9. Formatioii and Solution of the Normal Equations. If 

tJie number of unknown quantities is yi-eater tliau two, and 
especially if the number of obseiTations is large, the ntimeric;il 
computation of a set of normal equations is a laborious process, 
and one in which errors are almost certain to occur unless 
Kpecial precautions are taken to guanl against them. The 
method of forming tliese equations pi-esented in this section 
has been developed with special reference to facilitating the 
numerical operations and obtaining the nonnals with the least 
expenditure of labor consistent with the requisite accuracy, 
and although some of the processes may seem at first sight 
unnecessary and cumbrous, a little exjierience in their use. or 
in tlieir neglect, will convince the atiident that they are in 
the long run labor-saving devices. 

Let each observation equation be written out and ;irranged 
in tabular form, as in the following example. In order that 
tliese equations shoul<l furnish a good determination of the 
unknowns, x, y, z, it is necessary that the coefficients of these 
fiuantities should present a considerable range in their values 
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in the several equations. Thus, if all the coefficients of x 
were alike, all the coefficients of y equal each to each, etc., the 
equations would be absolutely indeterminate since we should 
have several unknown quantities involved in a single equation 
many times repeated, and if the coefficients approximate to 
this equality the equations will be approximately indeter- 
minate, and will furnish unreliable values of the unknowns. 
If, therefore, several observations liave been made under similar 
conditions, and furnish equations which are nearly identical, 
these will be nearly equivalent to a repetition of the same 
equation and it will be permissible to take their sum, having 
regard to their respective weights, and treat it as a single 
observation equation with a weight equal to the sum of the 
weights of the observations. 

Having thus reduced the number of equations as far as 
possible, each equation should be multiplied by the square root 
■of its weight as was done, § 7, in obtaining the form of the 
normal equations. By this multiplication the weights will be 
completely taken into account and will require no further 
attention. Let the iveighted equations thus obtained be repre- 
sented by 

a^'+h^ + <:-^ + "2 = '^ 

a?c + i;^ -f C3Z + «3 = 

etc, etc. etc. 

It will usually facilitate the formation of the normals to so 
transform these equations that no immber greater than 1 shall 
occur in any of them. This can always be done by introducing' 
new unknown quantities and dividing each equation by some 
constant number, usually some power of 10. Thus in the case 
of the two equations 

.')a: + 71.v~63 = 

0.9a; -193y + 93 = 
let each equation be divided by 100 and put 
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tlie equations are thus transformed into 

1.000m + 0.368W - 0.630 = 

O.ISOk - LOOOw + 0.930 = 
The solution ol' tliese equations will furnish values of v- and w 
from which a; and y may be found by the relations 

The purpose of this transformation is to simplify the subse- 
quent numerical work by reducing the nvimbers involved to 
an approximate equality. 

Every coefficient which appears in the normal equations is 
the sum of a series of products of two quantities, thus 

[fflw] = «,«, + (Vj + «3f 3 + ■ ■■ 

[a6] = a A + aA + «A + ■ ■ ■ 

[fill] = b^ii, + fi^jij + b,n, H 

These products may be formed by the aid of Crelle's multipli- 
cation tables* supplemented by a table of squares of num- 
bers for the [aa], [fiji], etc. In case Crelle's tables are not 
available, the products may be formed by logarithms or much 
more rapidly by the following method due to Bessel. Form for 
each equation the sums « -H 6, a + c, b + c, etc., for every pair 
of numbers contained in the equation ; then since 

ab = i\(tt + by-aa~lb] 
we have [afi] =f {[(a + fi)^ - [na] -[6&]1 ] 

etc. etc. etc. J 

The [cHx], [66], [co] are coefficients in the normal equations 
and must be computed in any case, and the formation of [a6], 
[fie], etc., therefore requires for each coefficient only the single 
additional quantity [{a + b}"], [(6-(-c)'j, and presents the 
very great advantage that these quantities can be obtained 

* Crelle, Rechentafeln. Herlin. These tables give the products of 
all numbers up to 1000 X iOOO, and are of very general utility. 
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from a table of squares, and being all positive numbers no- 
attention need be paid to the signs after the sums a + b, b + c, 
etc., have been formed. 

No method of computation can furnish a guaranty against 
the commission of numerical errors, and it is therefore desir- 
able to test the computation from time to time to ascertain if 
such errors have occurred. To secure such a test or " check," 
as it is called, we introduce the following auxiliary quantities, 
one for each observation equation : 



Check 



and form the quantities [as] [is]--- [sn]. It will appear from 
the mode in which the coefficients of the normal equations 
are formed that 

[««] + [«(,: + [«»] + ... + [».] = [»,]"] 

[<,4] + [M] + [6c] + ... + [6»: . M V (9.) 



The [as], [6s], etc., are formed in precisely the same manner 
as [a&], [oc], etc., and the check relations above given must 
be satisfied by the computed values of these quantities. 

Where only two unknown quantities are involved in the 
normal equations the solution of the equations may be con- 
veniently made by any of the methods of elementary algebra, 
but if the number of unknowns is greater than two, the simple 
and elegant method of successive substitutions proposed by 
Gauss may be employed with advantage. 

The normal equations in the case of three unknown quanti- 
ties are : 

[ao]>) + [oI.]s + M. + [a»]-0"| 
[aS]a:+[66]!,+ [Se]2 + [ta]=0 ^ (10> 

[a«]«+[Sc]j+tcc]z + [c»]=oJ 
and from the fii-st of these 

[.«]» [«o] [a«] 
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This value of x substituted in the second and third equations 
transforms them into 

[SS.l]j+[Sc.l>+[S,..i:-0 j 
[Sc.l]j + [cc-l]2 + [c...l]=(l ( ' ' 

in which 

[ss.i]B[6ij-M[„i,] [„.i]B|-„]„M[-„] 

[!.c.l]B[6o]-Kl[„] pc.l] = [6=]~M[a6] ). (12) 

[ta.i]s[s»]-|Sj[»"] ["■!]" [»:-j^^[««] 

These equations constitute a new set of normals, from which 
one unknoivn quantity has been eliminated. The correctness 
of the numerical work of this elimination may be tested by a 
continuation of the checlis used in forming the original nor- 
mals. We introduce an auxiliary quantity 

[6s.l] = [66.1] + [6c-l] + [6)i-l] 

and inquire its relation to [as], [6s], etc. If we substitute in 
the expression for [6s ■ Ij the values of [66 ■ 1], [6c ■ 1], [6n ■ 1] 
in terms of the original coefficients, having regard to the 
relations 

[aa] + [«6]+[ac] + [a^] = [«s] 1 

[a6] + [66} + [6c-]+[6»] = [6s] f ^^*^ 

we find [6s ■ 1] = [6.] - [«.6] - g3 j [««] _ [oa] j ■ 

whence [6s ■ 1] = [6s] - 1^ [as] 

and similarly, 

-Mr 
[<■<•] ^ 

We may therefore obtain a complete check upon the accuracy 
of the numerical work involved in the elimination of x, by 
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forming the quantities [&s ■ 1], [cs • 1], in the same iiiamier as 
[M-1], [dc-l], [6it-l], etc., and comparing the actual sums 
of these latter quantities with the computed check quantities. 
By a repetition of the process of elimination we obtain 



[cc.2]^ + [c«.2]=0 


c;.«ci 


c,.2] 


["■^']^[».i:-I^ 


4-jp-i]i 




:o,.o]=[,..,..i]-[^ 


4i:-.3 


' 


[™.2].[».i]^c:^ 


4-] [.>.!] 




= [«.2] + [« 


2] 





and we are enabled to write the following equivalents for the 
original normal equations. 



ElIMIN.M'JO.V EtJUATIII 



" + [«»] ■'+ [««] 



-J-o 






The last of these equations gives the value of z directly, the 
second furnishes y as soon as z is known, and the first gives 
the value of x. The whole solution is therefore reduced to 
finding the values of the coefficients and absolute terms in 
these elimination equations. A convenient arrangement of the 
computation by which these quantities are obtained is given 
in the following example, in which the actual computation is 
exhibited upon one page, and the opposite page contains a 
schedule correspondingly arranged showing the anal34ical 
equivalent of each number contained in the computation. 
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In making the multiplications o£ [«;<], [«c], [aw], [ets], by 

the constant factor i^, the logarithm of this factor is written 

[aa] 
on the edge of a slip of paper, and being held successively 
adjacent to the logarithms of [a6], [qc], [an], [as], the sum of 
the two logarithms is taken mentally, the corresponding num- 
ber IcKiked out from a logarithmic table and written in its 
proper place under [bb], [6c], [bii], [&s], a subtraction then 
gives the value of [bb ■ 1], [6c ■ 1], [bn ■ 1], [bs ■ 1], and a simi- 
lar process is followed for each other derived coefficient. 

§ 10. Example. To illustrate the principles contained in 
the preceding sections, and to exhibit in detail the process of 
deriving the most probable values of several unknown quanti- 
ties which are connected with the observed quantity by a 
i-ather complicated relation, we select from Vol. iii. Part 1 of 
the Memoirs of the Naiional Academy of Sciences, page 68, the 
following series of experiments made with a 10-gauge Colt 
gun, loaded with uniform charges of four drams of powder and 
IJ ounces of shot, the shot ranging in fineness from Ko. 10 
up to No. 1 Buck. The purpose of the experiments was to 
determine the relation existing between the size (fineness) 
of the shot and its average velocity over a range of 30 yards. 
The following table contains the results of the experiments, 
each velocity being the mean result of from three to six dis- 
charges of the gun. The weight of a pellet of No. 10 shot is 
taken as the unit of weight, and the velocities are expressed 
in feet per second. 



By plotting these results in a, curve with the weight of the 
shot as abscissas, and the observed velocities as ordinates, the 
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experimenter reached the conclusion tliat the relation between 
the weight If and the velocity V, is expressed by an equation 
of the form 

in wliich I, m, n, are constants whose values are to be deter- 
mined from the observations. It will be found upon trial that 
l^ = 700, via = 0.28, iifl = 0.42, in connection with the observed 
values of V and W will approximately satisfy this equation, 
and we therefore adopt these approximate values and proceed 
(5 8) to determine the corrections Al, Am, An, which when 
added to Iq, via, "m will furnish the most probable values of 
I, m, n. 

The several differential coefficients of the observation equa- 
tion, /(?, m, n, F) = are 

l£^-Acot^ 
d*no mo Ib 

in which M denotes the modulus of the common system of 
logarithms, M= 0.43429. In the factor, cot—, — ia the ratio of 
two numbers, and must be construed as representing a certain 
arc expressed in parts of the radius; the corresponding arc 



The form of the observation equatio 
here concerned is 



^logTFcot^Aii-Hf : 



and introducing into this equation the numeric;d i 
Zo, »io, "in Vi W, M, we find the following 
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EXAMPLE. 




'ii.oN Eau 


ATIOSS. 


im+ OA 


»+63- 


+ 104 


+ 32 = 


+ 154 


+ 24 = 


+ 172 


+ 28 = 


+ 170 


+ 38 = 


+ 159 


+ 37 = 


+ 142 


- 2 = 



(1) 1.29 ij- 729 A 

(2) 1..56 

(3) 1.41 
(1) 1.45 

(5) 1.48 

(6) 1.50 

(7) 1.52 

The absolute terms of these equations are residuals obtained 
by substituting iu the original equation 

I m 

the assumed values of l^, m„, and n„, and the sraaliness of 
these residuals compared with the values of V, shows that the 
assumed quantities are approximately correct values of I, m, ii. 
The memoir from which our data are taken contains uo indica- 
tion of the weights to be assigned to the several determinations 
of V, and in the absence of such information they should all be 
treated as equally precise and given the weight 1 ; but for the 
sake of illustration a slightly different set of weights indicated 
above by p has been assigned to them, and by multiplying each 
equation by the square root of its weight we obtain the follow- 
ing 

"VVeightkd OnsKKVATiox Equations. 



1.2i)Ai-729i) 


n+ Oa 


n+53=0 


1.3(i - 535 


4-104 


-f-32 = 


1,2(! - 352 


-1-137 


+ 21 = 


1.45 - 294 


-f-172 


-1-28 = 


I,fi2 - 239 


-1- 185 


-1-42 = 


1.5S - 172 


+ U7 


-1- 38 = 
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The coefficients and absolute terms in these equations are of 
veiy different magnitudes, and to simplify the subsequent 
mimerieal woi'k we divide each e<iuation through by 100 and 

i).016:i 7.2!) l.S.> 

and introduce x, y, z into the equations in place of A ?, A wt, A h. 
This stej), which is frequently called rendering the equations 
homogeneous, fvirnishes the following 



HOMOI 


^i.;nkoi,-.s WKic.ni-v:! 


) DusKiivATiox Eg 


UATIO.NS. 


0.7'Jli.); 


■— l.(HH>y + O.WMJs! 


; + 0.530 = « = 


+ 0.326 


0.83il 


_ o.7:i3 + o.rrfi-'i 


+ 0.320 = 


0.989 


0.777 


- 0.482 + 0.741 


+ 0.210 = 


1.246 


OMr, 


- 0.40;J + 0.i)31 


+ 0.280 = 


1.703 


1.00(1 


- 0.327 + 1.000 


+ 0.420 = 


2.093 


o.97r. 


- 0.236 + 0.90:) 


+ 0.380 = 


2.022 


0.938 


— 0.1C7 + 0.7(>.S 


— 0.02<) = 


l..'.IO 
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m 



The values of s~ a + b + c+ n, n-liich are to he nsed as a 
cheek in the formation of the iioi'iiial equations, ;u-e <Jerive<;l 
from these equations. 

The formation of the coefficients of the normal eqnatioiis hy 
the use of a table of squares, Bessel's methoil, is rejiresented in 
the following tables ; 



Sums of the Coeffk.'i 



E,„.t.«,. 


„.. 


..« 


= .. 


„>. 


..c 




>,., 


0,.J3l» 0,32li 


1.. 




0,204 


0.73C 


X,32« 


1.132 


1.000 


0.470 


0.074 


2.. 




.106 


1.402 


1.1511 


1.B28 


.170 


.413 


0.25fi 


0.8K.'i . 1.552 


S.. 




.395 


1.518 


0.987 


2.023 


.350 


.273 


0.7G4 


0.9.11 1 I.y«7 


4.. 




.492 


1.82(1 


1.175 


2,598 


.528 


.133 


1.300 


1.311 1 2.G34 


5.. 




.073 


2.000 


1.420 


3.093 


.(573 


.093 


l.TfiG 


I,4B0 ■ 3-093 


G. 




.73;) 


1.878 


1.355 


2.907 


.CfiT 


.144 


i-sr, 


1.283 '■ 3.925 


7,. 




.771 


i.7nc 


0,318 


2,4.^7 


-601 


.187 


1,;!.13 


0.74« a,L'M7 
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SQUA 


.ICS. 




-■ 


lllllll 


1 ■; 


3 ¥ 
+ 

+ 




-. 


1 1 i i s 3 § 


d - 




■• 


0.106 
3.409 
3,948 
0,938 
9,567 
8.55C 
5,230 


3 S 

S i 


+ + 




I 


0.281 

0,904 
1.466 
3.022 
1.G40 
0,560 


11 






Z 


0.000 
.317 
.549 
,867 

1,000 
.815 
.590 


2 : 








0,454 
0.066 
0,584 
1,690 
3,119 
3.190 
1,828 


g 1 


CO £.« 




e 


221 

171 
074 
015 
009 
021 
035 


1 S 




« 


d ■ 








^ 


OOO 
029 
067 
279 
453 
445 
361 


g t 


^ [g 


jL_-_— 




1 




« 


S S S 3 !5 1 i 


Si ■ 


-£■ 






" ■ 






J 


1,259 
3,342 
4,094 
6,750 
9.567 
8,982 
6,037 


i 1 

S 3 


+ """ + 




■s 


1,758 
1,343 
0,974 
1.381 
3,016 
1,836 
0,843 


2 S 


+ '^ 






0.634 
1,966 
2,304 
3,334 
4,000 
3,527 
2.910 


is 


ll 

+ 




1 


042 
Oil 
087 
242 
453 
546 
594 


S g 






j. ■ ■ ■ 




1 




% 


0,634 
,704 
.604 
.801 

l.OOO 
.931 
.880 


5 : 


+ '"' 




II 


_.„,., = .- 1 
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From the sums of the squares contained in the several col- 
umns of this table the coefficients [oft], [ac], etc., are computed 
at the foot of the columns by the relations 

[a!>] = i|[(a + 6)T-([a-] + [6'])!,etc. 

The check quantity [as] is compared with 

[aa] + lab] + [«c] + [<m] 

whose value is written immediately under [osj, and which 
must agree with [as] within two or three units of the last 
decimal place. Every coefficient oE the normal eqnations 
enters into one or more of these smns, which therefore furnish 
a complete test of the accuracy of the work in passing from the 
homogeneous observation equations to the normal equations. 
We now write the 

Normal Equatioks. 
+ 5.5763! - 2.861y + 4.480a + 1.876 = 
- 2.861a! + 2.122y - 1.813s - 1.200 = 
+ 4.480a; - 1.813y + 4.138z + 1-348 = 

It may be seen from an inspection of these equations that 
the data upon which they are based will not furnish a good 
determination of the values of all the unknowns, for if the 
first equation be divided by — 2 the quotient will be very like 
the second equation, and if it be multiplied by -|- 1 the product 
will be very like the third equation. We proceed, however, 
with the solution by Gauss' method, which will furnish the 
best results tliat the data can be made to yield. 



^yGooglc 
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Solution of the Nokmal Equations. 





] [,,S] 




los[«»] 


log[.,] 






[J,] 


['■J 


[1.] 
C"'Jr„] 




[SS.l] 
log[M-l] 


[Ic . I] 

i„t.[;,.i] 


iogp»,.i] 


[S..1] 
Check sum. 
log[S.l] 






t"lr„,i 







g 121^5 






log[„- 



log[,. 



.2] 



ELiMiNATio>r Equations, 



The ci 
ion equations is 
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+ 5 


7401 


- 2,8C,1 
0,45CC» 


+ 4.480 
0.6513 


0.2730 


+ 9.070 
0.95T6 






+ 2.122 

+ i.4ue 


-1.813 
-2.2110 


-1.200 
-0.902 


-3.753 
- 4,6,^4 




+ 0.«54 
)l.81.i(; 


+ 0,48C 
i).G8(!*l 


-0,23y 


+ 0.y02 
!),9o52 






+ 4.138 
+ 3.5!19 


+ 1.84S 
+ 1..-.07 


+ 8.153 
+ 7.Z8fi 



Ei.i.Mis.VTiox Ei^c. 



o..n;ij + o.so:fE + o.3yG = o 


.r = - 0.030 


-/ + 0.743 1-0.364 = 


J - + 0.439 


! + 0.101 = 


= = -0.101 


8,4771 !( logy 


n,G42J 


log = 


9.0019 


8.20i)5 log7.2il 


0.8fi27 


iogl^ 


0.2G72 


-1.8 A»> 


+ 0.0602 


in 


-0.0547 


700,0 TH„ 


+ 0.2800 




+ 0.4200 


698,2 


+ 0,3402 




+ 0.3653 
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If with the values of I, m, n thus obtained the corresponding 
velocities he computed by means of the original eqnation 

^'=aer >ii- 
i '' m 

tlie resulting lesiduals should be sm dler than those derived 
from the substitution oi I^ »i^ n, i e the absohite terms of 
the observation equitions The follow mi; comparison of these 
residuals shows a much bettei lepresentation of the observed 
values of V, especially li the -iiima of the squarea, [to], be 



Weight of Shot 1 2 4 8 le 33 64 

/Co ™<i "ii) - 53, - 32, - 24, - 28, - .18, - »?, +2 

/(i, m, t<) ~ 6, + 10, + 13, + 4, - lU, - 13, + 22 

Not only are the residuals diminished in magnitude, but 
their distribution is much more nearly in agreement with the 
law of error. 

The values thus obtained for I, m, n ought not to be con- 
sidered the best attainable, since the corrections Am, ^n are 
relatively large fractions of m^ and Hn> and it is probable that 
the neglected terms containing Am", Ah , etc., have an appreci- 
able influence upon the solution. To secure the utmost accuracy 
these values of I, m, n should be treated as new approximations 
and another set of corrections A I, Am, An derived. This re- 
solution is recommended to the student as a valuable exercise. 
Let the student also derive from the data of § 1 the most 
probable values of l^ and c, assigning unequal weights to the 
several equations. 

§ U, Conditioned Observations. There is a class of cases in 
which the application of the principle of least squares seems 
to produce absurd results. Thus if each angle of a plane tri- 
angle be measured many times in order to obtain an accurate 
set of values for the angles, the application of the principle 
that the [pvn] must be made a minimum will furnish as the 
moat probable value of each angle the weighted mean of the 
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measures of that angle, but the sum of these weighted means 
will uBunlly differ slightly from 180", and since the sum of the 
angles of every plane triangle must equal 180° it appears that 
the most probable values above derived ai-e impossible values. 
It must, however, be noted that the method of treatment above 
outlined is itself a violation of Principle A, § 1, since the knowl- 
edge that the sum of the angles must equal 180° furnishes a 
relation among those angles which may be used and ought to 
be used in determining their most probable values ; and the at>- 
parent absurdity above found is proiluced by neglecting this 
part of the data. 

A relation such as the above ivhich must be exactly satisfied 
by a set of observed quantities is called a rigorous condition, 
the equation by which the i-elation is expressed is called an 
equation of condition, and observations of sueii quantities are 
known as conditioned observations. The number of rigorous 
condition^ is, of course, always less than the number of un- 
known quantities, since if it were equal to the nuniber of such 
iiuantities the values of the latter would be determined by the 
conditions alone, independently of any olservations. 

In order to develop a convenient method of treating rigorous 
eonditions, let x, y, z be three unknown quantities which are to 
be determined from observation, but whose values are required 
to satisfy the equations of condition 

.i,(x,y,%) = {) <i.{x,y,%) = () 

Let the measurements or observations for the determination of 
the unknown quantities be represented by obseixation equa- 
tions of the form 

/,(3:,m) = My,n) = Mz,fi) = 

m, n, and q being the quantities directly measured, and the 
measures for the determination of x being quite independent 
of those for y, z, etc. In accordance with the principles of 
least squares the values of the unknown quantities are to be so 
determined that [p?w] shall be made a mhiimum in each series 
of observations above represented, and therefore the sum of all 
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tlie weighted squares of the residuals must also be a ii 
(.)wing to the conditions ^(k, y, z) = 0, ^(o;, i/, a) = it will not 
ill general be possible to assign to the unknown quantities 
values which will give to [piw] its least possible value, and the 
problem becomes one of conditioned or relative minima, i.e. 
out of all the sets of values of x, y, % which will exactly satisfy 
the equations of condition it is required to find that set which 
assigns to [psjr] its least value consistent with those equations. 
The method of determining relative minima is as follows : 
(Jordan, Cours d'Anal'/ne, Vol, i., § 205). Multiply each equa- 
tion of condition by an undetermined constant factor, and add 
the products to the function which is to be made a minimum. 
The derivative of the new function with respect to each un- 
known quantity must be placed equal to 0, and the equations 
thus formed, together with the equations of condition, will be 
just sufficient to determine the unknown quantities and the con- 
stant multipliers. Thus, in the present case, representing the 
multipliers by — 2 fc, and — 2 frj, wc have for the new function 

w= [pur]-2fc,^(a;, ./, z)-2k,^{x, y, %) (17) 

and *^ = ^" = -^'-^' = (IK) 

dx dy az 

will determine k„ frj, x, y, and z. 

It was shown in g 7 that in general fur three inikiiown 
quantities, 

5^tg!J = 2QMfl] X + 2lpab^ y + 2[2Jfl<:] a + 2\_pan'\ 

but in the case here considered those observation equations 
which contain x do not contain either y or %, and, therefore, the 
b and c coefiicieiits in those equations are to be considered 
zero, all the products ah, ac, are also zero, and 

^il^ = 2[paa]« + 2[pan] 

with similar expressions for the y and z derivatives. 
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Denoting for tte sake of brevity <t>{x, y, z) and ^{x, y, z) 
by <l> and i/- respectively, we obtain by differentiating lu 

'In 

from wliich 

[_paa'] dJ! Impact'} dx [jifto] 

^ [l3?'?']'^^y [i^W-] "^d^ [f^W'I 

[])cn] d4> A'l , ''if fta 

These equations determine the values of ir, y, z, when fci and 
fcj are known, and it should be observed that the first terms of 
the second members of the equations are the values of x, y, z, 
which would be obtained by treating the observations as if 
these quantities were entirely independent of each other, e.g. 
in the case of direct observations of the quantities they are 
the weighted means of the observations. If we represent the 
values thus obtained by 3:0, ^o, z^, and represent by v^ «■» v^ the 
corrections which must be added to these quantities in oi-der 
to obtain the most probable values of x, y, z, i.e. put 

x = Xi, + Vi y — yo+f^ s = z„ + uj 
we shall have 

_ _ rf0 fti dill I, 
' dx [poa] dx [/>aa] 



1^^ S'l dip ^ I /iin 

_d<t, k, dij, ks 
'~ dz' [pctQ rfz ■ [;«'f] 
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The quantities k^ aud k^ are called correlates, and from the 
manner in which they were introduced it appeal's that tlie 
number of correlates is equal to the number of rigorous con- 
ditions to which the observed quantities are subject. To 
determine the values of the correlates let Xa + v^, ^u+Va So + Ts 
be substituted for x, y, a in the equations of condition, and 
the equations developed by Taylor's Formula, giving for 
the 4>{x, y, e) 



^(.^■,„?/„.^.,) + ^ 



.#t.^+l*,., 



and a similar expression for ip{x, y, z). Let the values of 
'"]) *'!) ^3 in terms of ^i and A^ be substituted in tliese equations, 
and put 





(14, d^ 

dx dy 

V"[p66"] vL/Jc<^j •, 

Oyj, ''■'■ ■'" '' ' 

_ dy 

and the equations become 

[oa] \ + [a,3] fr, + .^(^, y^ %„) = Q\ 

from which the values of A:, and fcj may be obtained, and thus 
the values of r,, «j, v^ from equations (19). 

The method by which the above equations have been derived 
for the case of three unknown quantities connected by two 
equations of condition is perfectly general and may be ex- 
tended to any other number of quantities whose values axe 
to be obtained from independent observations. In the cases 
which actually arise in practice the observation equations and 
equations of condition are usually of simple form, the differen- 
tia! coetEcients and the quantities o, b, c, etc., being usually 
equal to either 1 or 0. 
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Problem. Let the student show by tlm iiietlioil of coiic- 
lates that if the sum of the measured angles of a plane triangle 
exceed 180° by a cLuautity e, the angles must l>e corrected by 
distributing e among them in such a manner that the coiTection 
to each angle is inversely proportional to the weiglit of the 
ang.le. 

To illustrate the application of the principles of the present 
section to a numerical pi-ohleni, we select from the U. S. C. & 
G. S'.trve>f Report for 1S84, pages 409 et seq., the following tele- 
yra])hie determinations of longitude, and seek to adjust them 
so that they shall be mutually consistent. Each difference of 
longitude between two stations was directly observed, so that 
the observation equations are ail of the form x = m„ x = 7n^ 
etc., and the values given below are the weighted means of the 
individual observations of each series. The probable error of 
each determination (see § 12) is placed immediately aft«r the 
quantity 'itself, ami the weights of the detenninations are 
assumed to be inversely projtortional to the squares of the 
probable erroi-s. 







i Observed 






Statiuns. 




1 I-cingitude. 


Vp 


0.032 


Cambridge, Mass. 
Vasliiiigton, D.C. 




J'o 23'"4i:0+l.t«'0is 


O.IM 


Cambridge, Mass. 
Cleveland, 0., 




U., '42 U.875i 0.038 


0.38 


.144 


Cambridge, Mass. 
Columbus. 0., 




s-„ 47 27.713j:0.ii3.-, 


0.3o 


.122 


Washington, D.C. 
Columbus, 0., 


I-- 


)(„ 23 4fi.8ieiO.03S 


Q.Sti 


.144 


Cleveland, 0., 
Columbus, O., 


[■• 


... . „,»..,„ 


0.45 


.202 



The five observed differences of longitude give rise to two 
rigorous conditions represented by the following equations of 
condition : 
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The coefficients in tlie observation equations being all equal to 
[))6i] = 2>g, etc, 



inity, 



and a, = '-^. 



[/IfflO.] -^ 

= '1* . ^ _ 

and from these expressions are derived the following values of 
the coef&cients, together with the sums Si = a, + ;8„ Sj = oj + ^a, 
etc, which are to be employed as a check upon the formatiun 
of the normal equations for determining the correlates. 

OOEFFICIEXTS. 



Subserlptx. 


^- 


it. 3. 


•• 


0.00 


„ 


+ 0.18 


0.00 


-0.35 


+ 0.38 


3 


0.00 


+ 0.38 


-0.35 


0.00 


+ 0.15 


' 


+ 0.18 


+ 0.38 


-0.70 


+ 0.38 


+ 0.45 



FORMATIOX OF THE CORKELATE EQUATION'S. 



cm 


ap 


.. 


PP 


Ps 


+ 0-0324 
.0000 
.1225 
.1*14 
-0000 


+ 0,0000 
.0000 
.1225 
.0000 
.0000 


+ 0,0324 
,0000 
,2450 
,1444 
,0000 


+ 0,0000 
,1444 
.1225" 
,0000 
.2025 


0,0000 
.1444 
,2450 
,0000 
,2023 


+ 0.2993 
Check, 


+ 0,1225 


+ 0,4218 
0.4218 


+ 0,4694 


+ 0,6919 
0,5919 



CoKitKLATE Normal Equaiio.vs, 
+ 0.29i)3 A:, + 0.1225^ + 0M44 = k, = - 0'.449 
+ 0.1225A, + 0.4G94ftj + .091 =0 k^=-0 .078 
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Ml'.027 


42 


14.864 


47 


27 .777 


Xi 


4C .751 


5 


12 .913 
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The absolute terms of the correlate equations are obtaiued 
by substituting the observed values a^, jo, z^, Wo, Wo in the equit- 
tiona of condition, and the values of k„ Jc^ may be found from 
the correlate equations, either by Gauss's method of substitu- 
tion or by any of the ordinary algebraic processes of elimina- 
tion. The corrections to o^, yo, x^, etc., and the adopted values 
of the unknown qoantities, are now found from 

Vi=+ 0.032 k, + 0.000 fcj = - 0'.014 

11^= +0.000 A:, + 0.144&j= -0.011 

!■, = - 0.122 fci - 0.122 fc, = + 0.064 

«,= +0.144fc, + 0.000ft2=-0.0G5 

V, - + 0.000 ky + 0.202 h=- O.OIG 

The values thus obtained satisfy the rigorous conditions of 
the problem, and are the most probable values which can be 
obtained from the data given above. 

§ 12. The Probable Error. Every intelligent observer 
<lesires to know something of the quality of his observations, 
how good or bow bad they are ; the computer who has to com- 
bine the results of different series of observations should have 
some knowledge of their relative accuraey in order to assign 
to each series its proper weight ; and the investigator engaged 
in a complicated series of experiments desires some criterion 
by which to estimate the relative errors of the several parts 
of his work, in order to properly apportion his care among 
them, giving the maximum attention where the greatest errors 
are to be feared. It is evident from the nature of the case 
that no absolute criterion of this kind can be furnished, since 
any series of observations may be affected with systematic 
errors which seriously impair the accuracy of its results but 
furnish no indication of their presence. Both observer and 
computer do, however, estimate the a^scuracy of observations 
by their agreement among themselves, and that within certain 
limits this procedure is correct follows from Oauas's law of 
error. If we suppose a very long series of observations 
affected only by accidental errors, the values of the unknown 
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quantities obtained from the series wiil differ but little from 
the true values (if the series is infinitely long tliey will be 
the true values), the residuals which they furnish will be very 
nearly the errors of observation, and the value of A in the 
equation of the error curve will furnish a measure of the 
precision of the observations as well as a measure of the 
smallness of the residuals. On the other hand, if the student 
attempts to construct the error curve corresponding to any 
short series of residuals, e.g., those of § 10, he vpiU lind that 
while they give him some information in regard to the curve 
there will be much that is arbitrary in its actual construction, 
and that many curves can be drawn which will appear Jo tit 
the residuals equally well, i.e. t!ie amount of data in this case 
is insufficient to determine more than a rough approximation 
to the measure of precision of the observations. If the obser- 
vations are affected with systematic eiTors, the residuals may 
be very different from the errors of the observations, and will 
then furnish no indication of their acciu-aej. 

It thus appears that any conclusions in regai'd to the ac- 
curacy of a given set of observations must be treated with 
caution if they are based solely on the residuals furnished by 
the observations. Such conclusions are, in fact, valid oidy 
within certain limits whose general nature is indicated above^ 
but within these limits the information thus furnished may be 
of much value, and it is frequently employed for the purposes 
indicated at the beginning of this section. 

The measure of precision, li, seems to be indicated by its 
name as the appropriate means of expressing the average 
accuracy of a set of observations, but in i>ractice it is not so 
used, another function of the residiials being found more con- 
venient. If in a very long series of observations the residuals ■ 
be arranged in the order of their numerical magnitude (with- 
out regard to sign), that residual which occupies the middle 
place in the series will have as many residuals greater than it 
as there are less than it, and in any future series of observa- 
tions of the same degree of precision as that here considered, 
it will be an even chance that any given residual will be 
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greater than, or less than, the middle one above selected. This 
middle residual is usually denoted by r, and is rather inappro- 
priately called the probable error of the series, the adjective 
having reference to the equal probabilities of the occurrence of 
residuals (errors) greater than, or less than, r. 

It is apparent that the greater the precision of any set of 
observation, the smaller ^vill be the corresponding probable 
error, but the exact relation which exists between k and r 
must be derived from the equation of the error cun-e. The 
symmetry of this curve with respect to the axis of y shows 
that the same law of distribution holds for both, positive and 
negative errors, and that in a very long series of residuals the 
error r will occupy the middle place among the 
e. errors and among the negative en-ors considered sepa^ 
rately, as well as among all the errors taken without regard 
to sign. Since we are concerned only with the numerical 
magnitude of r we may coniine our attention to the positive 
residuals, and find the relation between r and h from that half 
of the eii-or curve whicli lies to the right of the axis of y. 

Since the probable error is a residual, it must be represented 
by the abscissa of some point on the axis of x, and we may 
determine this point from the condition that the ordinate 
drawn through it bisects the area of that half of tlie curve 
under consideration, since (from the relation between areas 
and the number of residuals of a given magnitude developed 
in § 4) this is the geometrical equivalent of the statement 
that the number of residuals greater than r is equal to the 
number less than r. By interpolation from the table in § 4, 
the value of the argument corresponding to ^ = 0,25 is found 
to be A:c = kr =s 0.47T, whence the relation between the proba- 
ble error and the measure of precision is 

The student will observe that in the definition of the proba- 
ble error reference is made to a very long series of observations, 
and in a series of infinite length the value of r might be found 
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immediately from its definition, but in any ordinary set of 
observations it is better to assume that the residuals are dis- 
tributed in accordance with the law of error, and to determine 
the value of r from the relation between h and the sura of the 
squares of the residuals, § 5, which gives 

r=± 0.477 ViJ Jl—1 

We here encounter a difficulty arising from the attempt to apply 
to a short series of residuals principles which are rigorously true 
only when the series is of infinite length. Suppose the above 
expression for r applied to a series of three observations involv- 
ing three unknown quantities whose values are derived from 
the resulting observation equations. These values will exactly 
siitisfy the equations, no matter what the errors of the obser- 
vations may be, and the residuals being all zero, there will be 
found J- = and A = oo , which is absurd. The observations in 
this case furnish no data from which to estimate their pre- 
cision, and in every such case where the number of observa- 
tions is equal to the number of unknown quantities, the 
expression for the probable error ought to become indeter- 
minate, -. It is therefore customary to put 



,. = ±,u;r4^ri^ 



(23) 

in which ^ denotes the number of quantities whose values have 
been derived from the observations. This equation, which is 
known as Bessel's expression for the probable error of a sin- 
gle observation, being only an approximate one, we may usually 
put ^ in place of the coefficient 0.674. Among German physi- 
cists and astronomers, it is quite customaoy to suppress this 
coefficient altogether, and to use the "mean error" 

(24) 

for the comparison of observations. Geometrically considered, 
( denotes the abscissa of the ])oint of inflexion of the error 
curve. 



'>ia 
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A simpler expression for the probable error may be obtained 
by substituting in the eipiation 



a value of h deriveil as follows : Let each member of the equa- 
tiou of the error curve be multiplied by xdx and integi'ated 
between the limits — oo and +00, giving 

The value of the first integral in this equation is obviously 0, 
since as we pass along the error curve from —x to +30 every 
value of y occurs once associated with a negative value of x, 
and again with a numerically equal positive value, and for 
every negative element xydx in the Integral there occurs an 
equal positive xydx so that tlie entire sum is 0. If, however, 
we agree to neglect the sign of x and to condsider only its 
numerical value, we shall find 



I xydx = 2 J xydx 



and by a course of reasoning precisely similai- to that applied 
in § 5 to the quantity I i^yda, it may be shown that 2 | xydx 
is equal to the mean of all the residuals taken without regard 
to sign. We may therefore write 

where the + inside the bmckets denotes that all of the resid- 
uals are to be treated as positive quantities. Putting 7w = ( 
in the second member of this equation and remembering 
that here also we are concerned only with numerical values 
of X without regard to sign, we obtain 

Introducing the limits into the integrated expression there 
results [+"] 1 
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and 



= 0.4: 



7V^L±!-] 



(25) 



This formula is rigorously correct only when the number of 
observations is infinite, and it must be transformed so as to 
become indeterminate wlien the number of observation equa- 
tions ia just sufficient to determine the unknown quantities, 
i.e., when )i=s^ This might be accomplished by writing 
n—ij, in place of n, as was done in equation (19), but it is 
customary to substitute in this case -\/n(n — ^), which also 
renders r indeteiTninate when n = /x, aiid gives values of r more 
nearly in i^reement with equation (23). Making this substi- 
tution, we have 

r= ± 0.84r> C^t^] 

V«(«-"^) 

which is kno'WTi as Peters' formula for probable errors. This 
formula is very convenient for the numerical computation of 
probable errors, but where the number of observations is small 
the resrdts furnished by eqiiation (23) are considered more 
reliable, but neither formula can furnish a good determination 
of probable errors from a small number of observations. 

The mimerical application of these formuli© may be illus- 
trated by tlie following short series of sextant observations for 
the determination of latitude. 



(26) 



los[+«]I2.403 
■,,log Vu{n-i)\ 8.940-10 



0.92fi-10 
1.369 
■ ±ie".fi 



\og[m 
log(n-l 



4 40 
Mean = +3 4 2" 
n= 12 



[+«] = 253 [.r] = 770:i 



log 0.1574 :i 
log,- 
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The difference between the values of r founil from the first 
and second powers of the residuals is small eompareil with the 
uncertainty of each arising from the small number of obser- 
vations. 

In so far as these oi)Servations can be considered as, furnish- 
ing a value of v, tliey indicate that in a future series of similar 
and equally pi-eeise observations, there should be as many 
observations furnishing residiials (errors) greater than 18" as 
there are observations giving residuals leas than IS", The ± 
Tvliich is commonly prefixed to the numerical value of j-, denotes 
that the observed quantity is as apt to err in excess as in 
defect. 

Let the student derive from the residuals given in § 10 a 
determination of the probable error of an observed Y, noting 
that in this case /x = 3, 

§ 13. .Probable Error of a Function of Observed Quantities. 

Let x', x", x"' denote quantities which have been determined 
from observation, and let r', r", r"' be their probable errors. 
Let M be a quantity whose value has been computed from the 
values of x', x", a;"' by means of the relation 

/{x',x", x"',it) = 
It is evident that the precision with which u is determined, 
depends upon the precision of x', x", x'", and by a slight exten- 
sion of the term "pi'obable error" we may consider the pre- 
cision of u to be represented by a probable error, )-, and may 
inquire the relation of )■ to r', r", r'". 

Since a probable error is one of the residuals or eiTors of a 
very long series, we may obtain the desired relation between 
r, r', r", r"' from a consideration of the general relation of any 
set of errors v', v", v'", in »■', x", x'", to the corresponding 
error, v, in m. This relation is 

dx ax' ax" 

(see § 8). To avoid the necessity for considering the signs of 
v', v", v'", let this equation be sqiiared, giving 
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= ©■' 



■+ 



from which \11 tci w, mvolvmg the produUs v'v", v'v"', v"v"', 
etr hrti e Ijeen Iruj ped f i r the reason that the probable error 
ot It depends upon the averige magnitude of v, and in the long 
lun au^ pdir of residuals i i will have opposite signs as 
often IS thej 1 11 e like srgns in 1 will therefore produce aii 
equal number of p sitive and negative terms v. hose effect upon 
tK mean valie ot v' will be wry small compared with the 
terms uont^imng u * w '", « ' which aie alwiys positive. Ee- 
jWing these actuil eiror^ by the conesi ondiiig probable 
erroia \\e obtain 

\dx'J \dx"J \dx"'J 



C-'") 



and an equation of similar form wil! express the relation of 
the probable error of the fimetion to the probable errors of the 
(juantities upon which it depends, whatever the number of 
these quantities may be. 

We proceed to apply this relation to a few simple cases of 
frequent occurrence in practice. 

(a) The probable error of the sum of n observed quantities. 
In this case u = x' + x" + x'" + ••■ +x" 

and each of the differential coefficients ~^^, -^, etc., equals 1 ; 

■whence j^ = ?■' = + r"' + r'"'^ + ■■■ 4- r-^ (28) 

(b) The probable error of tlie mean of n obKerved quantities. 
In this case u = -{x' + x" + x'" + ■■• + x") 

if = -S- = etc.= > 

(to' (ix" H 

''=i,(>-"+'-'°+l-""+-'") 
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We have here to distinguish two cases. If the x's, are all of 
equal precisiouj the j''s are equal, and may be represented by a 
common symbol r, ; whence 



^#- = 



7= <^"' 

If the observations are of unequal precision represented by 
weights p', p", p"' ■■■p" 

;' + p"x" -i- p"'x "' -I p-x" 



we have 



"IS • 

' ~*vl5] 



(30) 



where r, denotes the probable error of an observation whose 
weight is 1. 

The relations here derived between the probable error of a 
single determination of a quantity, and the probable error of 
the mean of n determinations, may be employed in connection 
with equation (23), to determine the probable error of an 
adopted value based upon several determinations of a quantity. 
Thus, in the general case of observations of unequal weight, if 
j-i represent the probable error of an observation of weight 1, 
and r the probable error of the weighted mean, we have from 
equation (23), 



= 0.C74^£^ 



Let the student show that when the observations ; 
iqual precision and 
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= a (a:' - x" - a;'") r=±a^/3r' 



" = log (^'^ r = ± 0.434 \±+J-l'^ r' 

\x"J (.x" x"-i 

5 14. Assignment of Weights. Rejection of Observations. 

The term weight has been employed in the preceding sections 
as a measure of the quality of an observation, but its use is by 
no means limited to the case of single observations. Thus, 
from an Investigation of tJie Distance of the Snn, etc., by S. 
Neiowmb, we select the following determinations of the solar 
parallax. 

raothod by irlilcli del«rmiueil. Parallax. tVeiglit. 

Merkllaii observations of Mara, 18B2. 8", 865 25 

Micrometric observations of Mara, 1862. 8.842 6 

Parallftctic inequality of the Moon. 8.838 16 

Lunar equation of tlie Earth, 8.80a 3 

Transit of Venus, 1769. 8.860 6 

Each value of the parallax here given is the final result of 
an elaborate discussion of many observations, and the weights 
indicate the relative excellence attributed to these results by 
the author of the investigation. If w denote any one of these 
values of the parallax, ^ its weight, and tt,, the most probable 
value of the parallax, we shall have 

^. = ^1 = 8".847 ac>) 

[P] 
It is to be noted that this value depends upon the weights 
assigned to the individual determinations, and that by prop- 
erly selecting the weights, n-„ may be made to assume any value 
whatever between the least and the greatest single determina- 
tion. Thus if the weight 100 be assigned to the value 8".860, 
and to ea«h of the other values the weight 1, we shall find 
jr„ = 8".859, while a weight 100 for the value 8".809 with a 
weight 1 for each of the others, makes v„ = 8".811. Between 
these limits the value of tt^ depends upon the judgment of the 
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computer in assigning weights, aiid this determination of 
weights is one of the most delicate questions that arise in the 
application of the method of least squares. 

A relation between weights and probable errors may easily 
be established, which is frequently of service in that it enables 
the problem of weights to be stated in a different form. Let x 
denote an observation whose probable error is r ami whoso 
weight is 1, and denote by x', k", x"', etc., observations or com- 
binations of observations of the same qiiantity, whose weights 
and probable errors are represented by p', p", p'", r', r", r'", 
etc. Ill accordance with the definition of weights, x' is tiie 
equivalent of p' observations of tlie same quality as x, and 
from the equations derived in tlie preceding section we have 

''''°v,? 

with a similar expression for e;ich of the other quantities ; 
whence 

p' r''^ — })" /■" - =^ p'" >■'" ' = r' 

J.2 ,.2 _2 

and p' = — , ^" = — ^ //" = — ^^ (32) 

and, in general, the weights ai-e inversely proportional to tlif 
squaies of the probable erroi-s. 

It has been sufficiently showji that probable errors derived 
from the residuals furnished by a series of observations repre- 
sent only the effects of accidental errors of observation, but we 
may extend the significance of the term so as to include an 
estimate of the effect upon x\ x", x'" of systematic errors in 
the observations. Let r, and r, represent those parts of the 
probable error which come from these two sources respectively, 
and from § 13 we find for their combined effect 



and the expression for the weights becomes 
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By this device tlie determination of weiglits is reduced to ^i 
estimate of the combined effect of accidental and systematic 
errors of observation upon the quantity wliose weight ia 
desired, and it was from an estimate of this character that the 
weights of the parallaxes given above were derived. 

If r' denote the probable accidental error of a single obser- 
vation, and the quantity whose weight ia p is the mean of n 
such observations, we shall have 

P = tJ — («) 



from which the constant multiplier r" has been dropped, since 
only relative values of p are ever required. It appears from 
this equation that if the systematic errors, »•„ are very small 
compared with the accidental errors, r', the weight increases 
rapidly as the number of observations is increased, but if the 
systematic errors are large, the weight is but little affected by 
the number of observations ; a relation to be considered in 
deciding how many observations shall be made to determine 
an unknown quantity. 

In some cases it may be impossible to form any reliable 
estimate of the effect of systematic errors, and results which 
have been derived by different methods, or under different cir- 
cumstances, may then be given eqtial weights on the supposition 
that they are affected by different systematic errors which it 
is equally important to eliminate; but this is equivalent to 
putting fa = 00 in the equation for the weights, and it will 
rarely happen that this is the best estimate which can be made 
for the amount of the systematic errors. 

It frequently happens that in a series of otherwise accordant 
observations, one or two will be found which differ widely from 
the others, and which if included in the final result, will 
furnish large residuals. What shall be done with observations 
of this kind has long been a vexed question. To reject them 
is equivalent to assigning to them the weight 0, and is the 
expression of the computei-'s judgment tliat they can contribute 
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nothing to the accuracy of the result which he seeks to obtain. 
Ill an infinitely long series of observations, errors of any finite 
magnitude may be permitted without impairing the aeeuraey 
of the final result, and the existence of such errors seems con- 
templated by the theory which we have adopted, since the 
equation of the error curve gives finite values of y for all 
values of x between the limits — oo and -\- x . But in the 
actual case which arises in practice where a result must be 
obtained from a comparatively small number of observations, 
a single one of these, if affected with a large error, jnay make 
the final result farther fi-om the truth than any one of the 
other observations. On the other hand, cases are by no means 
unknown in which a single discordant observation in a series 
proves to be nearest to the true vahie of the quantity sought, 
the others having all been vitiated by some common cause ; 
and between these extremes an infinite variety of cases may 
be found. It must in general remain a matter of doubt 
whether a given dlscordsint observation should or should not 
1)0 rejected, and the decision made by the computer must l>e 
his judgment based upon all the data available as to whether 
more will be gained by rejecting than by retaining it. A knowl- 
edge of the way in wliich observations are made, of the circum- 
stances attending the particular oi)servation iu question, the 
magnitude of the errors which may reasonably be expected 
with the given observer and api^aratus, or instrument, are 
elements whicJi should be included in this judgment ; and the 
observer will greatly facilitate its formation by making copious 
notes at the time of observation of all circumstances which iu 
his opinion may affect the quality of his work, and particularly 
by noting any abnormal cii-cumstances affecting a single obser- 
vation or a part of the observations. 

A doubtful observation should be rejected if it is the com- 
puter's deliberate judgment that its retention will hurt more 
than it will help his final result, but it is never legitimate ffu- 
the computer to suppress an observation. A rejected observa- 
tion should be included in the st:i.tement of his data, and may 
properly be accompanied by an I'xjilanation of the reasons for 
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its rejection, in order that any person interested in the result 
may form his own judgment of the data and the manner in 
which they have been discussed, aud may, if necessary, re- 
discuss the observations in accordance with that judgment. 

The conclusion of the whole matter of assigning weights to 
numerical data may be summed up in the statement that no 
mathematical expression will suffice for this purtwse, but the 
weights must be determined by an exercise of personal judg- 
ment, and the wider the knowledge upon which this judgment 
is based, the greater coniidence will the weights and the i-esult- 
ing values of the unknown ([uantities command. 

^ 15. Empirical or Interpolation Formulae. In the preceding 
sections attention has been directed to that class of ])roblems 
in which the theoretical relation between the observed quanti- 
ties and those whose values ai-e to be determined is known ; 
that is, an equation of known form exists between them, and 
the problem has been to determine the values of the constants 
which appear in the equation. But a very different class of 
cases now demands a passing notice. 

A series of observations is sometimes found to lie afEected 
with errors too great to be explained as the result of unavoid- 
able and fortuitous causes, and it becomes apparent that the 
law of recurrence of these errors must be determined before 
the observations can be made to yield any valuable results. 
The American parties which wei-e sent out in 1874 to observe 
the transit of Venus were provided with instruments for the 
determination of their local time, of such a character that the 
accidental error of a determination from a single star might 
fairly be estimated at 0".05 or O'.OG, but results obtained from 
observations of diiferent stars varied among themselves by 
more than ten times this amount. An inspection of the dis- 
crepancies having shown that they depended in some way upon 
the distance of the observed star from the zenith, it was found 
by trial that the error at any zenith distance, «, could be repre- 
sented by the expression 
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■where a and b are constants whose values were found from tlie 
observations themselves. The physiea,! cause of these errors 
was subsequently found to be the bending of the instrument 
under its own weight, but it is to be noted that the above law 
of recurrence of the errors was determined first, the cause 
afterwards. 

Expressions of this kind ai-e sometimes called interpolation 
formulcb and sometimes empirital equations; tlie one term hav- 
ing reference to their use, the other to their derivation. They 
are of very genei-al use in all branches of physical scienci', 
since they may be matle to serve as a convenient summary of a 
vast amount of numerical data, and one of the most important 
applications of the method of least squares is in determining 
the values of the constants which enter into such expressions. 
The problems treated in S§ 1 and 10 both belong to this class, 
and the following expression for the magnetic declination at 
Washington, D.C., derived by Mr. O. A. Sdiott * from a series 
of observations extending over ninety years may serve us a 
further illustration ; 

Mag. Dec. = 2°.47 + 2°.50 sin[;i°.40(T-1850) - 14°.C] 
where T denotes the year for which the declination is required. 
When the cause whose effects are to be represented by an 
equation is known, the form of tliis equation can usually be 
derived by mathematical analysis ; but where empirical formula 
are employed other methods must be resorted to. The simplest 
of these is a graphical representation of the errors or other 
data under consideration. For this purpose let the errors 
represent ordiuatea, and the values of any variable upon which 
they are supposed to depend, the corresponding abscissas. Let 
points be plotted with these ordinates and abscissas as was 
done in obtaining the form of the en-or curve. Figs. A, B, C, D, 
and let a smooth curve be drawn through these points either 
free-hand or by the aid of a draughtsman's "irregular curve." 
Tlie distance of each plotted point from the curve, measured 
along an ordinate, is the residual corresponding to the point, 

• U. S. C. £ G. S. Rfporl. 1883, p. 258. 
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and in accordance with the principle of least squares the curve 
should be so drawn as to make the sum of the squares of these 
reaidnals as small as possible, without unduly complicating the 
curve. If the variable has been properly chosen it will in 
msiny cases be found possible to draw a simple curve which 
shall represent the data within the limits of the accidental 
errors of observation, and as this curve is the gi'aphieal rep- 
resentation of the law required, its equation, y=f{x), Is the 
analytical representation of that law. In this manner the 
form of the equation treated in § 10 was obtained. 

In other cases it will be possible to draw a smooth and sim- 
ple curve wliicli shall not represent the data within the limits 
of accidental error of the observations, but about which the 
points will be grouped, alternating from one side to the other 
in a systematic manner. Let the excess of the ordinate of any 
point over the corresponding ordinate of the curve be plotted 
with the given abscissa in a new curve. The two curves thus 
constructed will together form the graphical representation of 
the law of the data, and the analytic expression of that law 

"111"' j=/W + *W 

ii y ^f(x) and 1/ = i^(a;) are the equations of the two curves 



In some cases the curves themselves will be a sufficient 
representation of the data, and it will be unnecessary to deter- 
mine their equations since the value of y corresponding to any 
given value of x may be obtained by direct measurement. In 
other cases the curve will be chiefly serviceable in suggesting 
the probable form of an equation between the observed quan- 
tity and a variable upon which it is supposed to depend, or In 
showing that no simple relation exists between them. Two 
forms of equation are of such frequent use in this connection 
that they deserve especial notice. 

If the plotted curve does not differ very greatly from a 
straight line, the rehttion of the variable x to its f\inction y 
may be represented by 

y=a + b£ + .'J^ + d-e" + etc. (:iC>) 
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This equation contains tlie first few terms of an infinite 
series by which a limited arc of any continuous curve can be 
represented, and since tbe actual relation between y and x 
could be represented by a curve, if its mathematical expression 
were known, it follows that the above equation can be made to 
represent this relation over a certain range of values of x, by 
assigning proper values to the coef&cienta. The number of 
terms of this series which should be taken into account, and 
the limits of * beyond which the equation is not applicable, 
<lepend upon the actual relation between y and x, and are 
therefore unknown ; but, in general, it is not well to attempt to 
use this equation for large values of x, or when more than 
three or at most four terms are required. Its application in a 
simple case is illustrated in the problem of S 1, where y and x 
being replaced by the length of the bar and its temperature, it 
is assumed that their relation can be expressed within tlie 
range Of temperature over which the observations extend, by 
the lirst two terms of the seiies. 

The second type of equation above referreil to iw 

X 2x 'ix "l 

y = ao + «! cos — + Oj cos — + «, cos — + etc. 

+ &,sin— + 6,sin— + i3sin^^ + etc. 

in wliicb m is an undetermined constant expressed in the same 

unit as x; — is therefore a ratio, or absolute number, which 

in the application of the equation to numerical data must 
be transformed into circular measure by multiplying it by 

!=57°.29578. This form of equation may be made to 

represent any relation whatever between finite values of y and 
ar, including those cases in which y is a discontinuous function, 
but it is especially advantageous when y is a periodic function 
of X, i.e., one in which the same values of y recur for values of 
X, separated by a constant interval, r, called the period of x, 
so that 
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f{x)=f(=c + r)=f{x + 2r) = -=f(x+.r). 
The simpieat tyi)e of such a function is ;/ = sin.r, the period 
ill this case being t = 360° ; e.g., 

sin 10= = sin (10° + 360°) = sin (10° + 720°) = etc. 
When y is such a function the constant m should be put equal 
to the period divided by 2 tt, -m = — — ; in other cases tlie value 
of III should be so taken that tlie greatest value of — included 

among the data shall not exceed tt. The application of this 
formula may often be facilitated by noting that if the relation 
between J/ and x is such that f(^+x) =/( — x), the sine terms 
a41 disappear, and the equation reduces to 

)/ = «„ + «[ cos — + fflj cos- — |-etc. (37) 

while if /(a:) ~ —f{—x), the cosine terms vanish, and the 
equation becomes 

y = !>„ + b,sm~ + h si" — + etc. (38) 

The several forms above given to this type of equation are 
those most convenient for nae when the values of the coeffi- 
cients a, b, etc., are to be determined, but after their numerical 
values have been found it is advantageous to transform the 
equation as follows : Introduce the auxiliary quantities 

n„, m„ %, N„ Ns, etc. 
defined by the relations 

»ii,= ao III cos 7^1 = a, njCos^i = (ts 

111 sin 2ij = b, Mj sin JVj = b.^ 

and the equation becomes 

3, = B„ + n,cos^H_jV,"\ + «,cosr^- jV^^+ etc. (39) 

laced 
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each pair of terms of the original eqiiation being here replaced 
by a single term. The expression for the magnetic declination 



EMPIRICAL Olt iSTERPOLATION FORSIULJ':. 63 

at Washington given on p. 59 is of this type, as may be seen 
by writing it in the equivalent form 

Mag. Dee. = 2°.47 + 2'',50 cos [1°.40(T-1850) - 104".^] 

The mode of applying this form of eq^uation may be illus- 
trated by means of the following data selected from the series 
of observations whose lesidiials are plotted in Fig. C. The 
observed quantity, B, is the difference of stellar magnitude 
(brightness) between the planet Saturn and his satellite lape- 
tiis. The quantity I given with each observed B fixes the 
position of the satellite in its orbit at the time of observation, 
and is analogous to the variable angle ^ in a system of polar 
coordinates. 



70 11.81 +0.22 230 9.87 ~0,2I 

■ 110 U.tiO -0.03 270 10.43 +0.21 

140 11.42 -0.03 310 10.48 -0.15 

JB ia here seen to run through a complete cycle of values 

between the limits 9,87 and 11.81, while I varies from 0° to 

360°. We shall therefore endeavor to represent B usa, periodic 

function of I whose period is 360°, In accordance with this 

assumption we put 

5 = _L ^ 
m 360° ■ IT 



= 1; y = B 



and taking into account the first five terms of the series, the 
several observations furnish the following 

Observation Equations. 
10.82 = cfo + 0.98 a, + 0.17 ft, + 0.34 a, + 0.34 b^ 
11.81 = ao + 0.34 oi + 0.94 fi, - 0.77 «3 + 0.646, 
11.69 = a„ - 0.34 a, + 0.94 fi^ - 0.77 a, - 0.646, 
11.42 = o, - 0.77a, + 0.646, + O.lTa, - 0.98ft, 
10,66 = o„ - 0.94a, - 0.34 &, + 0.77 <h + 0.646. 
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y.87=«o— 0.64«,- 0.77 &,-0.17«i + 0,98 6s 
10.43 = <h + 0.00 a, - 1.00 h^ - 1,00 a, + O.OOfcj 
10.48 = a^ + 0.04fl, - 0.77 b, - 0.17 % - 0.98 b, 

The solution of these equations will be found in the follow- 
ing section. The values obtained for the constants are 

011=10.92, ni = + 0.15, 6, = + 0.74, «3 = -0.04, 6,^ = ^0.18 

Introducing the constants n, N, and determining their values 
from the relations 

)i„ = 10.92 If, cos xV, = + 0.15 n^ cos N. = - 0.04 
/(i sill .V, = + 0.74 «a sin^^Vj = - 0.18 
the equation becomes 

B = 10.92 + 0.76 coH(i - TS°.r,) - U.IS co.s {21- 77°.:.) 

The residuals obtained by comparing the values of B computed 
from this formula with the observed values are given above 
with the data. 

Abundant data for exercise in deriving empirical formnlje of 
this kind may be found in the Untied States Coast and Geodetic 
Survey Report for 1882, pp. 218-257. 

§ 16. Approximate SolutioDS. It is often desirable to obtain 
from a series of observations, as rapidly and with as little labor 
as possible, a set of values of the unknown quantities involved 
which shall be fair approximations to their most probable val- 
ues, but in which the highest degree of accuracy is not required. 
In cases of this kind the least square treatment of the obser- 
vation equations as illustrated in § 10 is too long and laborious, 
and the following method may often be substituted for it with 



Let there be any number, e.g., three, unknown (luantitiea in- 
volved in a set of observation equations of the form 
ax + by + cz-i-n^O Weight = p 
and let each of these equations be multiplied by its weight, 
giving the group of equations, 
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Uyx + b{y + cfi + )(, = 
asx + b^ + c^ + n^^d 
etc. etc. etc. e 

Multiply each of these eCLuations by tlie uiuletennined con- 
stant it placed opposite it, and let the sum of all the result- 
ing equations be formed. By the use of the summation 
symbol, [ ], tliis sum may be written 

Since the several values of k which enter into this equation 
are entirely arbitrai-y it would be pennissible to assigu to them 
such values that [fcfj] and [At] should each equal 0, which 
would give at once 

This, however, is not practically advantageous on account of 
the labor involved in determining the values of A'. We there- 
fore put 

and, limiting the values of A: to -|- 1 and — 1, assign them in 
such a manner that [fca] shall be made as gi-eat, and [ftftj, 
[ftc] aa small as possible. In this manner the coefficients of 
y and z may often be made so small that if approximate vahies 
of ^ andz are substituted iu equation (42), they will furnish 
a sufficiently accurate value of x ; since the effect of the errors 
of these approximations will be much diminished by the small 
coefficients by which they are multiplied. 

The value of y may be found in the same manner by select- 
ing a set of A''s which shall make [kb] large and [ka'J, [Arc] 
small, and similarly for z. Two or three trials may be required 
before sufficiently close approximations to the values of x, y, z 
are obtained, but these trials are rapidly and easily made, and, 
if necessary, in exceptional cases the summation equations 
may be written in the form 
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p"o>+[i"i]» + [*"«>+P"«] = '' y (-^> 
[Ji'"a]ji + p"'6]!/ + [*"'«> +[''""] = » J 
and the equations solved by my of the methods ot elementary 
algebiii, bnt in every ease the values ot t + 1 and - 1 should 
be so chosen that in the first equation the coefficient ot x, in 
the second equation the coefficient of y, and in the third equa- 
tion the coefficient of z, shall be made as large, and all of the 
other coefficients as small as possible. 

By this mode of solution each observation mth its proper 
weight is included in the determination of the unknowns, but 
since the principle of least squares has not been taken mto 
account, it cannot he expected that the resulting values will 
he the best that the observations can be made to yield 

To fflustiate the mode of solution we recur to the observa- 
tion equations contained in the preceding section and putting 
«, = 10.00 -)- a write them as follows, placing the several val- 
ues of k at the right of each equation. 

cosi ami cos3i 8in2i k' t" ^"' fc'" f 

0.82=.-l-0.98(.,-l-0.17!.,-l-0.94a,-l-0.346, -l-1-H-H + l-l-l 
1.81=a-Ha34ii,-t-0.946,-0.77a,-H0.646, -fl-H-f 1-1-1-1 
1.69=.-0.34a,-l-0.94S,-0.77 0,-0.646, -l-l-l-H-1-1 
1.42=«-0.77a,-H0.64S,-l-0.17 0,-0.984, -H-l-H+l-l 
0.66=.-0.94o,-0.346,-l-0.77c-l-0.64(., -H-l-l-H-l-1 
-0.13=.-0.64o,-0.776,-O17a,-(-0.986, -H-l-l-l-H 
0.43=.-t-0.00<.,-1.006,-1.00«,-t-0.00i, -H -1-1-1-1-1 
0.48=.-t.0.64o,-0.776.-0.17o,-0.984, -fH-l-l-l-l-l 

The summation equations obtained from this group arc : 
-f 7.18 •=8a-0.7.-ii., -0.194,- 1.00a, -l-O.OOi., "| 

-0.10 = 0« -I- 4.65o,-1.134i -!•«>«. + <'■<*"'■ I 

-)-4.30 = 0..H.lo<.,-l-6.574,-l-0.14o,-(-0.004, )■ (44) 

-0.42-0a-l-0.53a,-0.414,-H4.42o,-t-0.006, 

-0.86 = 0a-l-0.21«,-l-0.19^ -I- 2.540,-1- 5.204, > 
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and these correspond to the normal equations of a least square 
solution. To apply the method of approximations to the solu- 
tion of this group of equations, we write them in the form : 
a = +0.897 -|-0.091rti + 0.024&, + 0.125%^ 

a, = -0.022 + 0.000tt, + 0.243b, + 0.215aj 

6, = + 0.772 - 0.206 oi + 0.000 6, -- 0.025 « j > (45) 

a^= ~0.095-0.120aj + 0.0936i + 0.000o2 1 

b, = -0.166-0.040ai-0.03r>6,-0.488flJ 

The divisions required in malting this transformation wne 
made by the use of Crelle's Bechentafeln. 

By operations which can be performed mentally, we obtain 
the following sets of approximations to the values of 
I. 11. m. 

«, • 0.0 +0.2 +0.15 

U, + 0,8 + 0.7 + 0.74 

fij -0.1 -0.0 -0.04 

and substituting iu equations (45) the values given under iii, 
we find the adopted values 

«o = 10 + a = 10.92 ai=+0,15 n.s=-0.04 
6, = +0.74 b, = -0.18 
which were employed in the preceding section. 
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J__M Si 

._[1^ s ' 

[a[.]ii + [(*]» + Mii + [™] = " * 

[o6] = iS[(» + '')']-([""] + ["]'! * 

[m].L»«] + [»»] + M+-+[""l * 

pc.i] = M-g|w s 

:-^]=t»->i-gl4]p»-'] * 

[a.] li + [«/3] *. + *("%. 9" ^•) = '' *' 

, = ?^= ±0.674 JH=±0.84r,-J±i=. . SI 

r !1_ 51 

)/ = a + 6a: + c3;« + etc S- 

!, = „ + .,co.(|-if.)+»,cos(?,^-.>'.)+«t''.- . §: 
[ta] [»] [fc], j„^i . . . . S 
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Latin Text-Books. 



Allen & Greenough: Latin GranMnar gi.3i 

Csesar (7 books, with vocabulary; illustrated) . . . i.jt 
Cicero (C3 orations, with vocabulary; illustrated) . . 1.2' 

Sallust'e Catiline 6c 

Cicero de Senectute y 

Ovid, {with vocabulary) 1.4c 

Preparatory Course of Latin Prose 1.4c 

Latin Composition i.i; 

Allen , . . New Latin Metliod. 9c 

Introduction to Latin Composition 9c 

Latin Primer gc 

Latin Lexicon 9c 

Reninanta of Early Latin 75 

Qermania and Agricola ot Tacltos i.oc 

Blackburn . Bssontials ot LBtlo Graomiar .7c 

Latin Bzercises 6c 

Latin Grammar and BKercises [in one volume) . i.tx: 

Collar & DANiELL: BeKlnner'a Latin Book i.oc 

Latine Reddenda (paper) a; 

Latlne Eeddenda and Voo. (cloih) jr. 

College Series of Latin Authors. 

Oreenougti'B Satires and Epistles ol Horace 

Crowell . . Selections from the Latin Poets 1.4c 

Crowell & Richardson; Briof History ot Roman Lit. (Bender) i.oc 
Greenough . VlrEil: — 

Bucolics and 6 Books of JEneid (with vocab.) . i.6c 

Bucolics and 3 Books oC .^neid (witliout vocab.) i.is 

Last6Boolcaof .Staeid.and Georg'lcs (with notes) 1.1a 

TeiE of Virgfll (complete) '. . . . ^75 

Vocabulary to tbe rohole of Vlre'il i.oa 

GlNN & Co. , CJasBical Atlas and Geography (cloth) .... z.oc 

Halsev. . . Etymology of Latin and Greek 1.12 

Keep . . . EBaentiaiUsesoftlieMoodalnOreekandLatln .2; 

King . . . Latin Pronunciation 25 

Leigkton . . Latin Lessons 1.12 

First Steps in Latin 1,12 

Madvig . . Latin Grammar (by ThacherI 2.25 

Parkers Prepf.e; Handbook ot Latin Writing: 50 

Preble. . , Terence's Adelpboo 25 

Shumway. . Latin Synonym es 30 

Stickney , . Cicero de Natura Deorum 1.40 

Tetixjw . . Inductive Latin Lessons 1.12 

TOMLlNSON . Manual for the Study of Latin Grammar . . .20 

Latin tor Sight Reading 1.00 

White (T.W.) Schmidt's RhytHmic and Metric 2,50 

White Q.T.) Junior Students' Latin-English Lexicon (mor.) 1.75 

English-Latin Lexicon (slieep) 1,50 

Latin-Bnglisb and Engl^h- Latin Lexicon (sheep) 3.00 
Whiton . . AuxlllaVergiliana; or. First Steps in Latin Prosody .15 

Six Weeks' Preparation tor Reading Ceesar . .40 
Ct^ies sent to Teacktrs for Examinalion, with a view Id Infoduclien, 
OH rtccipt 0/ IntrodHCtion Priii. 

GINN & COMPANY, PubHshera, 

Boston, New York, and C:iicago. 
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GREEK TEXT-BOOKS. 



Medea of Euripides 

Hellenic Orations of DemoHtheGi 

Seven against Thebes . 



Goodwin : Greeit Grammar , 

Greek Reader 

Greek Moods and Tenses 

Selections from Xenophon aiid Herodotus 
Goodwin Sc White ; Anabasis, witJi vocabulary 
Hardine; Greek Inflection .... 

Hague : Irregular Verbs of Attic Prose . 

Jebb : IntJoductioQ to Homer . 

Keodrick: Greek at Sight .... 
Lelgliton : New Greek Lessons 

lilddell & Scott ; Abridged Greek-English Lexicoi 

Unabridged Greek-English Lexicon 



Sidswtck 
Tarbell ; 

White: 



Cebes'T^biel 
Selected Odea of Pindar 
Introduction to Language and Ver^ 
Homeric Vocalinlarv .... 
School Iliad, Books I.-III., SL25; Books 
Greek Prose Composition 
Philippics of Demosthenes . 
Selections from Greek Lyric Poets 



First Lessons in Greek . 

Schmidt's Rhythmic and Med 

Passages for Translation at i^ight. Pai 

CEdipos Tycannus of Sophod— 

Stein's Dialect of Herodotus 
Iton ; Orations of Lysiaa . 

Beckwitb: Euripides' Bacchantes, 

Te;tt and Notes, Paper, .95; Cloth, Sl.25 
D'Ooge : Sophocles' Antigone. 

Test and Notes, Paper, $1.10; Cloth, S1.40 
Dyer ; Plato's Apology and Crilo. 

Text and Notes, Paper, «U0; Cloth, 81-40; 
FlasE : Euripides' Iphigenia among the Taurians. 

Test and Notes, Paper, Sl.lO ; Cloth, S1.40 : 
Fowler; Thucydides, Book V. 

Teit and Notes, Paper, 81.10; Cloth, 8L'" 
Humphreys: Aristophanes' Cloads. 

Text and Notes, Paper, 81-10; Cloth, 81.40 
Manatt : Xenophon's Hellenica, Books I.-IV. 

TextJ-"--' — -' "■-■ 

Morris; Thucj , 

Tent and Notes, Paper, f 1.35: Cloth, S1.C5. 
Perrin: Homer's Odyssey, Books l.-IV. 

Tent and Notes, Paper, f 1.10 ; Ciotti, 81-^0 
RlohardBOn ; ,Esfihines against Ctesiphon. 

Text and Notes, Paper, f 1.10; Cloth, $1.40 
Seymour: Homer's liiad. Books I.-lII. 

Text and Notes, Paper, £1.10; Cloth, $1.40; 
Smith: Thucydides, Book VII. 

Text and Notes, Paper, $1,10; Ciolh, 81.40; 
Towle : Plato's Protagoras. 

Text and Notes, Paper, .!»; Cloth, 81.25 

filNli A COMPANY, Pablisliets, Boston, Hew YorK, and Chicago. 
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Mathematics,' 



Byetly Differential Calculiis *2.00 

Integral Calculus 3.00 

GInn Addition Manual 15 

Haleted Mensuration I.OO 

Hardy Quaternions 2.00 

HHl Geometry for Beginners 1.00 

Spragne Rapid Addition 10 

Taylor Elements of the Calculus I.fiO 

Weutworth Grammar School Arittinietic 75 

Shorter Course in Algebra 1.00 

Elements of Algebra 1.12 

Complete Algebra 1.40 

Plane Geometry 75 

Plane and Solid Geometry 1.25 

Planeand Solid Geometry,an(l Trigonometry 1.40 
I'lane Trigonometry and Tables. Paper. . Af) 
PI. and Sph. Trig., Surv., and Navigation . 1.12 

ri. and Sph. Trig., Snrv., and Tables 1.23 

Trigonometric Formulas 1.00 

Wentmntli&HIll: Practical Arithmetic 1.00 

Abridged Practical Arithmetic rs 

Exercises in Arithmetic 

Part I. Exercise Matiual 

Part II. Examination .Vanuai 35 

Answers (to both Parts) .23 

Exercises in Algebra TO 

Part I, Exercise Manital 35 

Part II. Exumination Maniial. 3j 

Answers (to both Partp) 35 

Exercises in Geometry 70 

Five-place Log. and Trig. Tables (T Tables) JO 

Five-place Log. and Trig. Tables (Comjj.^A) 1.00 

ft ^atworth & Reed : First Steps in Kumber, PupiW Edlttoa 30 

Teachers' Edition, complete .90 

Parts I , II., and HI. (separate), each .30 

Wheeler Plane and Spherical Trig, and Tables 1.00 

Copies sent lo Teachers for ej:amination, mlh a eiew lu Introduction, 
on receipt of Tntroduction Price. 



GINN & COMPANY, Publishers. 
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